00000001:02000400:0.0F:1788211472.794239:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788211494.071143:0:3186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1788211496.293025:0:3245:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 416 MB/s 00000001:01000000:2.0F:1788211496.542802:0:3245:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 371 MB/s 00000001:01000000:3.0F:1788211496.793454:0:3245:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3513 MB/s 00000020:02000000:1.0:1788211498.030370:0:3277:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_85_gb71fc30 00000400:02000000:1.0:1788211499.224630:0:3292:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.129@tcp [8/256/0/180] 00008000:02000000:0.0:1788211503.543330:0:3442:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788211562.541639:0:5244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788211573.707562:0:5824:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788211573.707572:0:5824:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788211573.707738:0:5824:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000065a49fed 00000080:02000400:0.0:1788211573.707752:0:5824:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788211573.714110:0:5824:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788211573.714126:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788211573.714304:0:5824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f3018ecd) 00000020:00000080:0.0:1788211573.714334:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788211573.780151:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788211573.780604:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788211573.855845:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788211573.855893:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788211573.855914:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788211573.855967:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788211573.856004:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788211573.857049:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788211573.857061:0:5824:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788211573.857074:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a51f0 00000020:01000004:3.0:1788211573.857083:0:5824:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788211573.857088:0:5824:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788211573.857099:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000065a49fed from MGS 00000020:01000004:3.0:1788211573.857103:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788211573.857138:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000bac385d2) 00000020:00000080:3.0:1788211573.857152:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788211573.857336:0:5824:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000065a49fed from MGS, refs=2 00080000:01000000:3.0:1788211573.857344:0:5824:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788211573.857349:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a51fe 00000100:00100000:3.0:1788211573.857725:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788211573.857956:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788211573.857962:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788211573.859309:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788211573.859320:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788211573.861344:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788211573.861920:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788211573.861927:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788211573.864697:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788211573.864715:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788211573.866128:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788211573.866143:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788211573.872804:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211573.872815:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211573.872820:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211573.873717:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211573.873721:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211573.873722:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211573.874871:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788211573.888748:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788211574.124322:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2739 MB/s 00000001:01000000:2.0:1788211574.374295:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3763 MB/s 00000001:01000000:0.0:1788211574.626077:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 689 MB/s 00000001:01000000:3.0:1788211574.879160:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 451 MB/s 00080000:10000000:0.0:1788211574.895069:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788211574.944525:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788211574.944651:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788211574.944655:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788211574.946765:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788211574.946853:0:5824:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788211574.946945:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788211574.947220:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788211574.947245:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788211574.947844:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211574.948037:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788211574.948047:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:1.0:1788211574.949518:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211574.949529:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788211574.949537:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788211574.951642:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788211574.951657:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788211574.956243:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788211574.956275:0:5824:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.129@tcp' 00000020:01000004:2.0:1788211574.956277:0:5824:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788211574.956340:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.129@tcp (typ=mgc) 00000020:00000080:2.0:1788211574.956366:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.129@tcp (0000000068e5d3fc) 00000020:00000080:2.0:1788211574.956397:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788211574.956527:0:5824:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000042162a4a@MGC192.168.204.129@tcp: add connection 192.168.204.129@tcp at head 00010000:00010000:2.0:1788211574.956893:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.129@tcp-0 is initialized 00000040:01000000:2.0:1788211574.956900:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788211574.957253:0:5839:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788211574.957281:0:5840:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788211574.957323:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.129@tcp (uuid afe7852e-b478-4e21-8864-7e739fb0a137) 00000020:00000080:1.0:1788211574.957343:0:5824:0:(genops.c:1385:class_connect()) connect: client afe7852e-b478-4e21-8864-7e739fb0a137, cookie 0x2afbce82f55a520c 00000100:00080000:1.0:1788211574.957354:0:5824:0:(import.c:510:import_select_connection()) MGC192.168.204.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788211574.957360:0:5824:0:(import.c:624:import_select_connection()) MGC192.168.204.129@tcp: import 0000000042162a4a using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211574.957512:0:5824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000239a1318 x1875075660775552/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788211574.957533:0:5824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import afe7852e-b478-4e21-8864-7e739fb0a137->MGS 00000020:01000004:1.0:1788211574.957548:0:5824:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788211574.957553:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788211574.957639:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000064e96fe4) 00000020:00000080:1.0:1788211574.957650:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788211574.958698:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000239a1318 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:afe7852e-b478-4e21-8864-7e739fb0a137:3307:1875075660775552:0@lo:250: 00000100:00100000:3.0:1788211574.958810:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211574.958889:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660775552 00000100:00100000:3.0:1788211574.958899:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660775552 00000100:00100000:3.0:1788211574.958950:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788211574.959104:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1015b73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1875075660775552:12345-0@lo:250: 00010000:00080000:3.0:1788211574.959136:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from afe7852e-b478-4e21-8864-7e739fb0a137@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:3.0:1788211574.959196:0:5835:0:(genops.c:1385:class_connect()) connect: client afe7852e-b478-4e21-8864-7e739fb0a137, cookie 0x2afbce82f55a521a 00000100:00080000:3.0:1788211574.959877:0:5835:0:(import.c:65:import_set_state_nolock()) 0000000075bc73fa : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788211574.960011:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1015b73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+5:3307:x1875075660775552:12345-0@lo:250: Request processed in 1046us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211574.964655:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788211574.966736:0:3307:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788211574.966770:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.129@tcp: connect to target with instance 0 00000100:00080000:2.0:1788211574.966782:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788211574.966789:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788211574.966794:0:3307:0:(import.c:65:import_set_state_nolock()) 0000000042162a4a MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788211574.966799:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788211574.966808:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788211574.966816:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000239a1318 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:afe7852e-b478-4e21-8864-7e739fb0a137:3307:1875075660775552:0@lo:250: 00000100:00100000:1.0:1788211574.973893:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788211574.976475:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788211574.976496:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788211574.985641:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788211574.985662:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788211574.990390:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788211574.990412:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788211574.993755:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788211574.994130:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788211574.994138:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788211574.995811:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788211574.995823:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788211575.068117:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211575.069104:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788211575.069112:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788211575.074567:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788211575.074588:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788211575.075752:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788211575.075944:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788211575.075951:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788211575.076678:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788211575.076687:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788211575.088118:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788211575.088919:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788211575.088928:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788211575.089727:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788211575.089736:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788211575.090501:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788211575.090800:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788211575.090806:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788211575.092034:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788211575.092046:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788211575.143565:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788211575.144040:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788211575.144048:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788211575.146591:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788211575.146607:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788211575.147476:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788211575.147487:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788211575.151050:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788211575.151081:0:5824:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788211575.151089:0:5824:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788211575.151252:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788211575.151292:0:5824:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.129@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788211575.151298:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788211575.151299:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788211575.151301:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788211575.151302:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788211575.151303:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788211575.151304:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788211575.151306:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788211575.151307:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788211575.151308:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788211575.151310:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788211575.151311:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788211575.151313:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788211575.151315:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788211575.151317:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788211575.151319:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788211575.151320:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788211575.151321:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788211575.151322:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788211575.151323:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788211575.151324:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788211575.151326:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788211575.151326:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788211575.151327:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788211575.151328:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788211575.151329:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788211575.151372:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788211575.151395:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007ff532e pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660775680:0@lo:253: 00000100:00100000:0.0:1788211575.151514:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211575.151571:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aaea9c6f going to sleep for 11 seconds 00000100:00100000:2.0:1788211575.151727:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660775680 00000100:00100000:2.0:1788211575.151737:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660775680 00000100:00100000:2.0:1788211575.151779:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211575.151786:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002975e527 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+5:5824:x1875075660775680:12345-0@lo:253: 20000000:01000000:2.0:1788211575.151830:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788211575.151833:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788211575.153804:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788211575.153878:0:5838:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788211575.154265:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788211575.155343:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788211575.155848:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788211575.155853:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788211575.155860:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788211575.155864:0:5838:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788211575.155879:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788211575.156309:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788211575.156599:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788211575.156613:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788211575.156678:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788211575.156752:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788211575.157138:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788211575.157498:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788211575.157508:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788211575.157562:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788211575.157571:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788211575.157603:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788211575.157612:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788211575.157642:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788211575.157708:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788211575.157742:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788211575.157748:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788211575.157763:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788211575.158805:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788211575.158826:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788211575.158877:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788211575.158916:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788211575.158992:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788211575.159009:0:5838:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788211575.159104:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788211575.159113:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788211575.159154:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788211575.159217:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788211575.159253:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788211575.159267:0:5838:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788211575.159370:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788211575.159380:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788211575.159414:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788211575.159451:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788211575.159632:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788211575.159681:0:5838:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788211575.159689:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788211575.160565:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788211575.161137:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788211575.161161:0:5838:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.129@tcp for mdt 20000000:01000000:3.0:1788211575.161339:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.129@tcp (null) (null) (null) 00000040:00080000:3.0:1788211575.161381:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788211575.161390:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788211575.161420:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788211575.161428:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.129@tcp (null) (null) 00000040:00080000:3.0:1788211575.161474:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788211575.161486:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788211575.161538:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788211575.161573:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788211575.161645:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788211575.161648:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788211575.161653:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788211575.161666:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788211575.161670:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788211575.161702:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788211575.161704:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788211575.162404:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788211575.162669:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788211575.162712:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788211575.162813:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788211575.162827:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788211575.162830:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788211575.163389:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788211575.163833:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788211575.163875:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788211575.163907:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788211575.163921:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788211575.163925:0:5838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788211575.163929:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788211575.163931:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788211575.163936:0:5838:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788211575.163943:0:5838:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788211575.164433:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788211575.164618:0:5838:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788211575.175864:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788211575.175924:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788211575.177187:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788211575.177882:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788211575.177910:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008a75a928/0x2afbce82f55a5221 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.177931:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a75a928/0x2afbce82f55a5221 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.177943:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a75a928/0x2afbce82f55a5221 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.177981:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a75a928/0x2afbce82f55a5221 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.177988:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008a75a928/0x2afbce82f55a5221 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.177996:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008a75a928/0x2afbce82f55a5221 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.178003:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008a75a928 already unused, calling callback (00000000c752be12) 00010000:00010000:3.0:1788211575.178008:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008a75a928/0x2afbce82f55a5221 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.178016:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008a75a928/0x2afbce82f55a5221 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.178035:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008a75a928/0x2afbce82f55a5221 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.178043:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008a75a928/0x2afbce82f55a5221 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.178049:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008a75a928/0x2afbce82f55a5221 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788211575.178069:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788211575.404525:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002975e527 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+5:5824:x1875075660775680:12345-0@lo:253: Request processed in 252728us (253002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211575.404547:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788211575.404653:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007ff532e pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660775680:0@lo:253: 10000000:01000000:0.0:1788211575.404673:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788211575.404677:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788211575.404679:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788211575.404681:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788211575.404682:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788211575.404683:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788211575.404685:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788211575.404686:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788211575.404687:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788211575.404689:0:5824:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788211575.404691:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788211575.404692:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788211575.404720:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000065a49fed from lustre-MDT0000 10000000:01000000:0.0:1788211575.404750:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788211575.404753:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788211575.404758:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8abfca8a4d28 10000000:01000000:0.0:1788211575.404762:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788211575.404770:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8abfca8a4d28 from 1 10000000:01000000:0.0:1788211575.404772:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788211575.404807:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 000000006c714bf8/0x2afbce82f55a5228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.404819:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 000000006c714bf8/0x2afbce82f55a5228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.404828:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 000000006c714bf8/0x2afbce82f55a5228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211575.404847:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007ff532e pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660775808:0@lo:101: 00000100:00100000:0.0:1788211575.404913:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211575.405028:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038b92b2d going to sleep for 11 seconds 00000100:00100000:3.0:1788211575.405131:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660775808 00000100:00100000:3.0:1788211575.405139:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660775808 00000100:00100000:3.0:1788211575.405284:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788211575.405294:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012b1ad85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+5:5824:x1875075660775808:12345-0@lo:101: 00010000:00010000:3.0:1788211575.405318:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211575.405336:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a75a928/0x2afbce82f55a522f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5228 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.405364:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a75a928/0x2afbce82f55a522f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5228 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.405376:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a75a928/0x2afbce82f55a522f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5228 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.405461:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a75a928, rc 0) 00000100:00100000:3.0:1788211575.405557:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012b1ad85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+6:5824:x1875075660775808:12345-0@lo:101: Request processed in 264us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211575.405565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788211575.405645:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007ff532e pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660775808:0@lo:101: 00010000:00010000:2.0:1788211575.405660:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 000000006c714bf8/0x2afbce82f55a5228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a522f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.405668:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 000000006c714bf8/0x2afbce82f55a5228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a522f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211575.405740:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062636979 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660775936:0@lo:501: 00000100:00100000:2.0:1788211575.405776:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211575.405845:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000538cebd4 going to sleep for 11 seconds 00000100:00100000:3.0:1788211575.405882:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660775936 00000100:00100000:3.0:1788211575.405887:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660775936 00000100:00100000:3.0:1788211575.405920:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788211575.405926:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e32789d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+6:5824:x1875075660775936:12345-0@lo:501: 00000100:00100000:3.0:1788211575.406241:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e32789d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+6:5824:x1875075660775936:12345-0@lo:501: Request processed in 316us (465us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788211575.406249:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788211575.406457:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062636979 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660775936:0@lo:501: 10000000:01000000:2.0:1788211575.406482:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788211575.406535:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 000000006c714bf8/0x2afbce82f55a5228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a522f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.406543:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 000000006c714bf8/0x2afbce82f55a5228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a522f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211575.406552:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8abfc288e800 10000000:01000000:2.0:1788211575.406556:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788211575.406560:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8abfc288e800 10000000:01000000:2.0:1788211575.406562:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788211575.406565:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8abfc288e800 from 1 10000000:01000000:2.0:1788211575.406567:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788211575.406591:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 00000000ab057fe1/0x2afbce82f55a5236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.406597:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 00000000ab057fe1/0x2afbce82f55a5236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.406604:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 00000000ab057fe1/0x2afbce82f55a5236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211575.406616:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062636979 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660776064:0@lo:101: 00000100:00100000:2.0:1788211575.406645:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211575.406672:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000538cebd4 going to sleep for 11 seconds 00000100:00100000:3.0:1788211575.406729:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660776064 00000100:00100000:3.0:1788211575.406735:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660776064 00000100:00100000:3.0:1788211575.406800:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788211575.406807:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa1bf363 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+6:5824:x1875075660776064:12345-0@lo:101: 00010000:00010000:3.0:1788211575.406817:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211575.406827:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000af0c7da4/0x2afbce82f55a523d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5236 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.406854:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af0c7da4/0x2afbce82f55a523d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5236 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.406861:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000af0c7da4/0x2afbce82f55a523d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5236 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.406868:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000af0c7da4, rc 0) 00000100:00100000:3.0:1788211575.406898:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa1bf363 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+7:5824:x1875075660776064:12345-0@lo:101: Request processed in 92us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211575.406903:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788211575.407055:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062636979 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660776064:0@lo:101: 00010000:00010000:2.0:1788211575.407073:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 00000000ab057fe1/0x2afbce82f55a5236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.407079:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 00000000ab057fe1/0x2afbce82f55a5236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211575.407090:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788211575.407225:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 00000000ab057fe1/0x2afbce82f55a5236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.407233:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 00000000ab057fe1/0x2afbce82f55a5236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211575.407239:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788211575.407243:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788211575.407247:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8abfc288e800 10000000:01000000:2.0:1788211575.407249:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788211575.407252:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788211575.407254:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788211575.407267:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 00000000e33fe802/0x2afbce82f55a5244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.407272:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 00000000e33fe802/0x2afbce82f55a5244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.407278:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 00000000e33fe802/0x2afbce82f55a5244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211575.407289:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062636979 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660776192:0@lo:101: 00000100:00100000:2.0:1788211575.407318:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211575.407346:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000538cebd4 going to sleep for 11 seconds 00000100:00100000:0.0:1788211575.407403:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660776192 00000100:00100000:0.0:1788211575.407408:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660776192 00000100:00100000:0.0:1788211575.407442:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788211575.407449:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b476e230 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+7:5824:x1875075660776192:12345-0@lo:101: 00010000:00010000:0.0:1788211575.407457:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211575.407467:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000081728a7b/0x2afbce82f55a524b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5244 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.407480:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081728a7b/0x2afbce82f55a524b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5244 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.407488:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000081728a7b/0x2afbce82f55a524b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5244 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.407494:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000081728a7b, rc 0) 00000100:00100000:0.0:1788211575.407521:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b476e230 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+8:5824:x1875075660776192:12345-0@lo:101: Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211575.407527:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788211575.407666:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062636979 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660776192:0@lo:101: 00010000:00010000:2.0:1788211575.407678:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 00000000e33fe802/0x2afbce82f55a5244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a524b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.407685:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 00000000e33fe802/0x2afbce82f55a5244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a524b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211575.407732:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062636979 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660776320:0@lo:501: 00000100:00100000:2.0:1788211575.407758:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211575.407779:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000538cebd4 going to sleep for 11 seconds 00000100:00100000:0.0:1788211575.407829:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660776320 00000100:00100000:0.0:1788211575.407833:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660776320 00000100:00100000:0.0:1788211575.407863:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788211575.407868:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032cbc6c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+8:5824:x1875075660776320:12345-0@lo:501: 00000100:00100000:0.0:1788211575.408108:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032cbc6c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+9:5824:x1875075660776320:12345-0@lo:501: Request processed in 239us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211575.408115:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788211575.408199:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062636979 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660776320:0@lo:501: 00000100:00100000:2.0:1788211575.408226:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062636979 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660776448:0@lo:503: 00000100:00100000:2.0:1788211575.408262:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211575.408287:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000538cebd4 going to sleep for 11 seconds 00000100:00100000:3.0:1788211575.408358:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660776448 00000100:00100000:3.0:1788211575.408362:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660776448 00000100:00100000:3.0:1788211575.408393:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788211575.408399:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ef55cc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+9:5824:x1875075660776448:12345-0@lo:503: 00000100:00100000:3.0:1788211575.408566:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ef55cc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+9:5824:x1875075660776448:12345-0@lo:503: Request processed in 168us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211575.408573:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788211575.408728:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062636979 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660776448:0@lo:503: 00000100:00100000:2.0:1788211575.409272:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062636979 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:5866:1875075660776576:0@lo:502: 00000100:00100000:2.0:1788211575.409320:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211575.409353:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9252335 going to sleep for 11 seconds 00000100:00100000:3.0:1788211575.409508:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660776576 00000100:00100000:3.0:1788211575.409514:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660776576 00000100:00100000:3.0:1788211575.409553:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788211575.409561:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf37fc49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+9:5866:x1875075660776576:12345-0@lo:502: 00000100:00100000:3.0:1788211575.409756:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf37fc49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+9:5866:x1875075660776576:12345-0@lo:502: Request processed in 196us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211575.409763:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788211575.409873:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062636979 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:5866:1875075660776576:0@lo:502: 00000020:01000000:0.0:1788211575.409908:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211575.409920:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211575.409923:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788211575.409930:0:5866:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788211575.409933:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788211575.409948:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000add9820c) 00000020:00000080:0.0:1788211575.409980:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788211575.409988:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788211575.410064:0:5866:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788211575.410071:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a5259 00000020:00000080:0.0:1788211575.410339:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788211575.410344:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211575.410348:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211575.410349:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788211575.410352:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211575.410355:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211575.410356:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788211575.410359:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788211575.410365:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f6f485c3) 00000020:00000080:0.0:1788211575.410376:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788211575.410380:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788211575.410448:0:5866:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788211575.410451:0:5866:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788211575.410460:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788211575.410519:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000065a49fed from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788211575.410533:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000061daa9db) 00000020:00000080:0.0:1788211575.410541:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788211575.410596:0:5866:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788211575.410602:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a526e 00000020:00000080:0.0:1788211575.410697:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788211575.410703:0:5866:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788211575.410707:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2afbce82f55a5275 00080000:01000000:0.0:1788211575.410712:0:5866:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788211575.410721:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a527c 00080000:10000000:0.0:1788211575.411139:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788211575.411650:0:5866:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788211575.415745:0:5866:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788211575.472945:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788211575.473610:0:5866:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788211575.475487:0:5866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788211575.475737:0:5866:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788211575.510409:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a44565dd) 00000020:00000080:3.0:1788211575.510435:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788211575.510517:0:5866:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788211575.510529:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a528a 00000020:00000080:3.0:1788211575.513609:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788211575.515073:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788211575.558137:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788211575.595267:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211575.620313:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211575.668030:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788211575.755090:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788211575.862527:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2afbce82f55a5291 00000020:00000080:2.0:1788211575.866789:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788211575.866813:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211575.866828:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211575.866831:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788211575.866855:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211575.866864:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211575.866865:0:5866:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788211575.866869:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788211575.866870:0:5866:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788211575.866874:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211575.866876:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211575.866877:0:5866:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788211575.866880:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211575.866884:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211575.866885:0:5866:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788211575.866889:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788211575.866948:0:5866:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788211575.867034:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e943c99 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:5866:1875075660776704:0@lo:502: 00000100:00100000:2.0:1788211575.867149:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211575.867271:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c90c83e5 going to sleep for 11 seconds 00000100:00100000:1.0:1788211575.867338:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660776704 00000100:00100000:1.0:1788211575.867349:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660776704 00000100:00100000:1.0:1788211575.867413:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788211575.867421:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062435040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+9:5866:x1875075660776704:12345-0@lo:502: 00000100:00100000:1.0:1788211575.867803:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062435040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+9:5866:x1875075660776704:12345-0@lo:502: Request processed in 380us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211575.867813:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788211575.867852:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e943c99 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:5866:1875075660776704:0@lo:502: 00000020:01000000:2.0:1788211575.868050:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211575.868057:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211575.868059:0:5866:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788211575.868062:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788211575.868502:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788211575.868524:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788211575.868550:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 00000000e33fe802/0x2afbce82f55a5244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a524b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.868563:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 00000000e33fe802/0x2afbce82f55a5244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a524b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211575.868572:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8abfc288e800 from 1 10000000:01000000:3.0:1788211575.868576:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788211575.868632:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.868640:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.868650:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211575.868671:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005de5dddd pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660776832:0@lo:101: 00000100:00100000:3.0:1788211575.868714:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211575.868762:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc95f94c going to sleep for 11 seconds 00000100:00100000:2.0:1788211575.868887:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660776832 00000100:00100000:2.0:1788211575.868893:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660776832 00000100:00100000:2.0:1788211575.868937:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788211575.868945:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012b5398b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+9:5824:x1875075660776832:12345-0@lo:101: 00010000:00010000:2.0:1788211575.868965:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211575.868981:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052043f28/0x2afbce82f55a529f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5298 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.869003:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052043f28/0x2afbce82f55a529f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5298 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.869021:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052043f28/0x2afbce82f55a529f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5298 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.869030:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052043f28, rc 0) 00000100:00100000:2.0:1788211575.869080:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012b5398b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+10:5824:x1875075660776832:12345-0@lo:101: Request processed in 136us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211575.869087:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788211575.869257:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005de5dddd pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660776832:0@lo:101: 00010000:00010000:0.0:1788211575.869272:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a529f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.869280:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a529f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211575.869863:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005bc28d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660776960:0@lo:256: 00000100:00100000:0.0:1788211575.869917:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211575.869963:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d62aeb20 going to sleep for 11 seconds 00000100:00100000:2.0:1788211575.870141:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660776960 00000100:00100000:2.0:1788211575.870148:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660776960 00000100:00100000:2.0:1788211575.870197:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788211575.870205:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000572447e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+10:5824:x1875075660776960:12345-0@lo:256: 20000000:01000000:2.0:1788211575.870223:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788211575.870229:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788211575.870308:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000572447e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+10:5824:x1875075660776960:12345-0@lo:256: Request processed in 105us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211575.870316:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788211575.870354:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005bc28d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660776960:0@lo:256: 10000000:01000000:2.0:1788211575.871085:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788211575.871097:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a529f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.871108:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a529f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211575.871673:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfc288e800 from 1 10000000:01000000:2.0:1788211575.871676:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788211575.871714:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.871734:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.871743:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211575.871944:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e943c99 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660777088:0@lo:101: 00000100:00100000:2.0:1788211575.872024:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211575.872109:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8184ef1 going to sleep for 11 seconds 00000100:00100000:1.0:1788211575.876846:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660777088 00000100:00100000:1.0:1788211575.876870:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660777088 00000100:00100000:1.0:1788211575.876972:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788211575.876985:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4516ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+10:5824:x1875075660777088:12345-0@lo:101: 00010000:00010000:1.0:1788211575.877012:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211575.877049:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c7c1ac07/0x2afbce82f55a52ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a52a6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.877086:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7c1ac07/0x2afbce82f55a52ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a52a6 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.877099:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c7c1ac07/0x2afbce82f55a52ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a52a6 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.877142:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c7c1ac07, rc 0) 00000100:00100000:1.0:1788211575.877284:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4516ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+11:5824:x1875075660777088:12345-0@lo:101: Request processed in 302us (5261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211575.877292:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788211575.877621:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e943c99 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660777088:0@lo:101: 00010000:00010000:3.0:1788211575.877646:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a52ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.877666:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a52ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211575.877763:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000349493f pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660777216:0@lo:501: 00000100:00100000:3.0:1788211575.877803:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211575.877853:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ca8e3d7 going to sleep for 11 seconds 00000100:00100000:2.0:1788211575.877919:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660777216 00000100:00100000:2.0:1788211575.877925:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660777216 00000100:00100000:2.0:1788211575.877950:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788211575.877969:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b59013b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+11:5824:x1875075660777216:12345-0@lo:501: 00000100:00100000:2.0:1788211575.878588:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b59013b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+11:5824:x1875075660777216:12345-0@lo:501: Request processed in 630us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211575.878597:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788211575.879045:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000349493f pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660777216:0@lo:501: 00000100:00100000:3.0:1788211575.879083:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000349493f pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660777344:0@lo:503: 00000100:00100000:3.0:1788211575.879138:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211575.879188:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ca8e3d7 going to sleep for 11 seconds 00000100:00100000:2.0:1788211575.879327:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660777344 00000100:00100000:2.0:1788211575.879333:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660777344 00000100:00100000:2.0:1788211575.879373:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788211575.879380:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea6565d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+11:5824:x1875075660777344:12345-0@lo:503: 00000040:00080000:2.0:1788211575.879425:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788211575.879467:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea6565d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+11:5824:x1875075660777344:12345-0@lo:503: Request processed in 88us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211575.879475:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788211575.879555:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000349493f pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660777344:0@lo:503: 00000040:00080000:1.0:1788211575.880583:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788211575.880861:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788211575.880880:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788211575.880897:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a52ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.880909:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a52ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211575.880966:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788211575.880969:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8abfc288e800 10000000:01000000:3.0:1788211575.880972:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8abfc288e800 10000000:01000000:3.0:1788211575.880975:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788211575.880981:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8abfc288e800 from 1 10000000:01000000:3.0:1788211575.880984:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788211575.881015:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 00000000c2fbf3d1/0x2afbce82f55a52b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.881031:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 00000000c2fbf3d1/0x2afbce82f55a52b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.881042:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 00000000c2fbf3d1/0x2afbce82f55a52b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211575.881059:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000349493f pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660777472:0@lo:101: 00000100:00100000:3.0:1788211575.881107:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211575.881146:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c04d4fc4 going to sleep for 11 seconds 00000100:00100000:2.0:1788211575.881476:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660777472 00000100:00100000:2.0:1788211575.881483:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660777472 00000100:00100000:2.0:1788211575.881523:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788211575.881536:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5ff3a5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+11:5824:x1875075660777472:12345-0@lo:101: 00010000:00010000:2.0:1788211575.881549:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211575.881560:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004885be45/0x2afbce82f55a52bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a52b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.881582:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004885be45/0x2afbce82f55a52bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a52b4 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.881592:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004885be45/0x2afbce82f55a52bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a52b4 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211575.881600:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004885be45, rc 0) 00000100:00100000:2.0:1788211575.881642:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5ff3a5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:5824:x1875075660777472:12345-0@lo:101: Request processed in 106us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211575.881648:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788211575.881743:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000349493f pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660777472:0@lo:101: 00010000:00010000:0.0:1788211575.881768:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 00000000c2fbf3d1/0x2afbce82f55a52b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a52bb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.881776:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 00000000c2fbf3d1/0x2afbce82f55a52b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a52bb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211575.881830:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000553383d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660777600:0@lo:501: 00000100:00100000:0.0:1788211575.881858:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211575.881888:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b818851c going to sleep for 11 seconds 00000100:00100000:3.0:1788211575.882016:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660777600 00000100:00100000:3.0:1788211575.882021:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660777600 00000100:00100000:3.0:1788211575.882056:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788211575.882063:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc882414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:5824:x1875075660777600:12345-0@lo:501: 00000100:00100000:3.0:1788211575.882355:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc882414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:5824:x1875075660777600:12345-0@lo:501: Request processed in 293us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211575.882362:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788211575.882394:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000553383d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660777600:0@lo:501: 00000100:00100000:3.0:1788211575.882420:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acde0b6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660777728:0@lo:503: 00000100:00100000:3.0:1788211575.882456:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211575.882469:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c04d4fc4 going to sleep for 11 seconds 00000100:00100000:3.0:1788211575.882480:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660777728 00000100:00100000:3.0:1788211575.882483:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660777728 00000100:00100000:3.0:1788211575.882499:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788211575.882503:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ce08668 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:5824:x1875075660777728:12345-0@lo:503: 00000100:00100000:3.0:1788211575.882923:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ce08668 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:5824:x1875075660777728:12345-0@lo:503: Request processed in 418us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211575.882941:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788211575.882999:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acde0b6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660777728:0@lo:503: 00000100:00100000:2.0:1788211575.886518:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045e78e77 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:5871:1875075660777856:0@lo:502: 00000100:00100000:2.0:1788211575.886640:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211575.886777:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a91dfaea going to sleep for 11 seconds 00000100:00100000:3.0:1788211575.886902:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660777856 00000100:00100000:3.0:1788211575.886911:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660777856 00000100:00100000:3.0:1788211575.886975:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788211575.886983:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7b30f24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:5871:x1875075660777856:12345-0@lo:502: 00000100:00100000:3.0:1788211575.887349:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7b30f24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:5871:x1875075660777856:12345-0@lo:502: Request processed in 365us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211575.887358:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788211575.891080:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045e78e77 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:5871:1875075660777856:0@lo:502: 00000020:01000004:0.0:1788211575.891228:0:5871:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788211575.891267:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000206c79f8) 00000020:00000080:0.0:1788211575.891289:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788211575.891388:0:5871:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000065a49fed from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788211575.891392:0:5871:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000065a49fed from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788211575.891395:0:5871:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000065a49fed 4 00010000:00080000:0.0:1788211575.891441:0:5871:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000070a4a19b@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:0.0:1788211575.895003:0:5871:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788211575.895424:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788211575.895468:0:5871:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788211575.895483:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2afbce82f55a52c9 00000100:00080000:0.0:1788211575.895497:0:5871:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788211575.895502:0:5871:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000070a4a19b using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1788211575.895544:0:5871:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cebf03fc x1875075660777984/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788211575.898466:0:5871:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788211575.898594:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cebf03fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660777984:0@lo:38: 00000100:00100000:2.0:1788211575.898708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211575.898906:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660777984 00000100:00100000:0.0:1788211575.898918:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660777984 00000100:00100000:0.0:1788211575.899009:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788211575.899018:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012c26144 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875075660777984:12345-0@lo:38: 00000100:00100000:0.0:1788211575.899089:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012c26144 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875075660777984:12345-0@lo:38: Request processed in 71us (381us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788211575.899097:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788211575.899504:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acde0b6d pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:5871:1875075660778112:0@lo:502: 00000100:00100000:3.0:1788211575.899553:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211575.899581:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660778112 00000100:00100000:3.0:1788211575.899585:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660778112 00000100:00100000:3.0:1788211575.899618:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788211575.899625:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057a8114a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:5871:x1875075660778112:12345-0@lo:502: 00000100:00100000:3.0:1788211575.899878:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057a8114a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:5871:x1875075660778112:12345-0@lo:502: Request processed in 252us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211575.899886:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788211575.900005:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f7530c8c going to sleep for 11 seconds 00000100:00100000:3.0:1788211575.900028:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acde0b6d pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:5871:1875075660778112:0@lo:502: 00000040:00080000:3.0:1788211575.900055:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788211575.900121:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788211575.900139:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788211575.900153:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 00000000c2fbf3d1/0x2afbce82f55a52b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a52bb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.900200:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 00000000c2fbf3d1/0x2afbce82f55a52b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a52bb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788211575.900254:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788211575.900257:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788211575.900258:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211575.900259:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211575.900261:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211575.900263:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211575.900264:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788211575.900266:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788211575.900268:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788211575.900270:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788211575.900272:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211575.900274:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788211575.900277:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788211575.900281:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788211575.900282:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788211575.900284:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211575.900285:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211575.900286:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211575.900287:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211575.900287:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788211575.900288:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788211575.900290:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788211575.900290:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788211575.900291:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211575.900292:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788211575.900306:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788211575.900314:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acde0b6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660778240:0@lo:253: 00000100:00100000:3.0:1788211575.900347:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211575.900363:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ca8e3d7 going to sleep for 11 seconds 00000100:00100000:3.0:1788211575.900381:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660778240 00000100:00100000:3.0:1788211575.900385:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660778240 00000100:00100000:3.0:1788211575.900408:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788211575.900421:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a39cb941 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:5824:x1875075660778240:12345-0@lo:253: 20000000:01000000:3.0:1788211575.900444:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788211575.900460:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788211575.908580:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788211575.908600:0:3307:0:(import.c:65:import_set_state_nolock()) 0000000070a4a19b lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788211575.908610:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788211575.908616:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cebf03fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660777984:0@lo:38: 20000000:01000000:3.0:1788211575.955311:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788211575.955335:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788211575.955494:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788211575.955500:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788211575.955525:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.955545:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000052043f28/0x2afbce82f55a529f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5298 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.955553:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.955597:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000052043f28/0x2afbce82f55a529f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5298 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.955613:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000052043f28/0x2afbce82f55a529f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5298 expref: 12 pid: 5836 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211575.955628:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001cfbc509 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1875075660778368:0@lo:104: 00000100:00100000:1.0:1788211575.955700:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211575.955764:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d46fa17 going to sleep for 11 seconds 00000100:00100000:3.0:1788211575.956315:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660778368 00000100:00100000:3.0:1788211575.956324:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660778368 00000100:00100000:3.0:1788211575.956488:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788211575.956498:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000df0a31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+3:5859:x1875075660778368:12345-0@lo:104: 00010000:00010000:3.0:1788211575.956512:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a529f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211575.956576:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788211575.956582:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000df0a31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+3:5859:x1875075660778368:12345-0@lo:104: Request processed in 87us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211575.956588:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788211575.956678:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001cfbc509 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1875075660778368:0@lo:104: 00010000:00010000:1.0:1788211575.956701:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.956839:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211575.956846:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a529f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.956854:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c488f893 already unused, calling callback (000000006f28ef8b) 10000000:00010000:0.0:1788211575.956857:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a529f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.956877:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a529f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211575.956884:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a529f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211575.956890:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788211575.956930:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a529f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.956937:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211575.957152:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a529f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.957160:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: 00000000c488f893/0x2afbce82f55a5298 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a529f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211575.957201:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211575.957202:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211575.957204:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211575.957263:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6a6cc81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660778496:0@lo:103: 00000100:00100000:0.0:1788211575.957569:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211575.958001:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660778496 00000100:00100000:1.0:1788211575.958009:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660778496 00010000:00010000:1.0:1788211575.958035:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000052043f28/0x2afbce82f55a529f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5298 expref: 13 pid: 5836 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211575.958083:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788211575.958091:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007590986 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+13:3309:x1875075660778496:12345-0@lo:103: 00010000:00010000:1.0:1788211575.958102:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211575.958107:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000052043f28/0x2afbce82f55a529f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5298 expref: 13 pid: 5836 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.958117:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000052043f28/0x2afbce82f55a529f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5298 expref: 13 pid: 5836 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.958131:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000052043f28/0x2afbce82f55a529f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5298 expref: 13 pid: 5836 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.958144:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.958152:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788211575.958191:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002691755s 00010000:00010000:1.0:1788211575.958195:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.958201:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.958220:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.958226:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.958232:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a8336448 already unused, calling callback (00000000c752be12) 00010000:00010000:1.0:1788211575.958236:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.958242:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.958256:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.958265:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211575.959108:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007590986 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+12:3309:x1875075660778496:12345-0@lo:103: Request processed in 1014us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211575.959120:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788211575.959188:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.959199:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211575.959205:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a8336448/0x2afbce82f55a52d0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211575.959746:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6a6cc81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660778496:0@lo:103: 00000100:00100000:2.0:1788211575.968645:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a39cb941 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+11:5824:x1875075660778240:12345-0@lo:253: Request processed in 68215us (68288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211575.968662:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788211575.968971:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acde0b6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:5824:1875075660778240:0@lo:253: 10000000:01000000:3.0:1788211575.968989:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788211575.968992:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788211575.969505:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788211575.969507:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211575.969508:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211575.969509:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211575.969510:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211575.969512:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788211575.969514:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788211575.969515:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788211575.969517:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788211575.969518:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211575.969520:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788211575.969537:0:5824:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788211575.976472:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788211575.979053:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788211575.980135:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788211575.980546:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788211575.981007:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788211575.982055:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788211575.982459:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788211575.983988:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788211575.984218:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788211575.984526:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788211575.984743:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788211575.985649:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788211575.986106:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788211576.051473:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788211576.113367:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788211576.113549:0:5876:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788211576.113555:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788211576.114185:0:5877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788211576.122987:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788211576.123220:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788211576.125932:0:5824:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788211576.126669:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788211576.127098:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788211576.128256:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788211576.131591:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788211576.131635:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788211576.131905:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788211576.132303:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788211576.136508:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788211576.136841:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788211576.136989:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788211576.137123:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788211576.137543:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788211576.137689:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788211576.137835:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788211576.138365:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788211576.140028:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788211576.142564:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788211576.142804:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788211576.146604:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788211576.146935:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788211576.147215:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788211576.147370:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788211576.148738:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788211576.149068:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788211576.151869:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788211576.152111:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788211576.152294:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788211576.152465:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788211576.152637:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788211576.152787:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788211576.156704:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788211576.157011:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788211576.157247:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788211576.157425:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788211576.157558:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788211576.157702:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788211576.157839:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788211576.158015:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788211576.158213:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788211576.158463:0:5824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788211576.218885:0:5877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788211576.313004:0:5824:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788211576.313056:0:5824:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa765c18f7988 00100000:10000000:1.0:1788211576.313073:0:5824:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:0.0:1788211576.316265:0:5877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788211576.316965:0:5877:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788211576.316972:0:5877:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:2.0:1788211576.318680:0:5824:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788211576.318703:0:5824:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788211576.318721:0:5824:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788211576.318743:0:5824:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788211576.997407:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211578.021507:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211579.047127:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211580.069771:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211581.095208:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788211581.157253:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788211581.157264:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8abfc288e800 from 3 10000000:01000000:3.0:1788211581.157269:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788211581.157319:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 000000008321b094/0x2afbce82f55a52d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211581.157331:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 000000008321b094/0x2afbce82f55a52d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211581.157342:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 000000008321b094/0x2afbce82f55a52d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211581.157397:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acde0b6d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660778624:0@lo:101: 00000100:00100000:3.0:1788211581.157475:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211581.157718:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660778624 00000100:00100000:2.0:1788211581.157727:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660778624 00000100:00100000:2.0:1788211581.157777:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788211581.157786:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab60abef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+11:5840:x1875075660778624:12345-0@lo:101: 00010000:00010000:2.0:1788211581.157799:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211581.157812:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009960165e/0x2afbce82f55a52de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a52d7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211581.157835:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009960165e/0x2afbce82f55a52de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a52d7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211581.157845:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009960165e/0x2afbce82f55a52de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a52d7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211581.157875:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009960165e, rc 0) 00000100:00100000:2.0:1788211581.157914:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab60abef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:5840:x1875075660778624:12345-0@lo:101: Request processed in 129us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211581.157921:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788211581.158201:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000adb93b46 going to sleep for 11 seconds 00000100:00100000:3.0:1788211581.158227:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acde0b6d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660778624:0@lo:101: 00010000:00010000:3.0:1788211581.158240:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 000000008321b094/0x2afbce82f55a52d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a52de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211581.158249:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 000000008321b094/0x2afbce82f55a52d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a52de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211581.158299:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acde0b6d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660778752:0@lo:256: 00000100:00100000:3.0:1788211581.158331:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211581.158355:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000adb93b46 going to sleep for 11 seconds 00000100:00100000:2.0:1788211581.158481:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660778752 00000100:00100000:2.0:1788211581.158485:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660778752 00000100:00100000:2.0:1788211581.158521:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788211581.158607:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005519fcc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:5840:x1875075660778752:12345-0@lo:256: 20000000:01000000:2.0:1788211581.158624:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788211581.158642:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788211581.158645:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788211581.158797:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005519fcc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:5840:x1875075660778752:12345-0@lo:256: Request processed in 194us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211581.158805:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788211581.158903:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acde0b6d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660778752:0@lo:256: 10000000:01000000:3.0:1788211581.158944:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788211581.158950:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 000000008321b094/0x2afbce82f55a52d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a52de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211581.158958:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 000000008321b094/0x2afbce82f55a52d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a52de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788211581.161889:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788211581.161902:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788211581.161906:0:8:0:(import.c:65:import_set_state_nolock()) 0000000070a4a19b lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788211581.161922:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000070a4a19b using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1788211581.161969:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001a4d1be4 x1875075660778880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788211581.162202:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001a4d1be4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660778880:0@lo:38: 00000100:00100000:3.0:1788211581.162282:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211581.162480:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660778880 00000100:00100000:2.0:1788211581.162488:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660778880 00000100:00100000:2.0:1788211581.162590:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211581.162599:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acde0b6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875075660778880:12345-0@lo:38: 00010000:00080000:2.0:1788211581.162623:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:2.0:1788211581.162674:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2afbce82f55a52e5 00000004:00100000:2.0:1788211581.162790:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788211581.162944:0:5845:0:(import.c:65:import_set_state_nolock()) 0000000010fe9bc3 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211581.163010:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acde0b6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875075660778880:12345-0@lo:38: Request processed in 411us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211581.163017:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788211581.163220:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001a4d1be4 x1875075660778880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788211591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788211581.163253:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788211581.163262:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788211581.163267:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788211581.163270:0:3307:0:(import.c:65:import_set_state_nolock()) 0000000070a4a19b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788211581.163276:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001a4d1be4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660778880:0@lo:38: 00000001:02000400:3.0:1788211581.533638:0:6120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788211582.118203:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211583.147103:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211584.166667:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211585.189436:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211586.215813:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211586.277713:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000722b50a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660779008:0@lo:400: 00000100:00100000:1.0:1788211586.277820:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211586.277894:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788211586.277900:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd4f24a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660779136:0@lo:400: 00000100:00100000:1.0:1788211586.277934:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211586.277977:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660779136 00000100:00100000:1.0:1788211586.277986:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660779136 00000100:00100000:1.0:1788211586.278037:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788211586.278047:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cfbc509 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660779136:12345-0@lo:400: 00000100:00100000:1.0:1788211586.278101:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cfbc509 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660779136:12345-0@lo:400: Request processed in 55us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211586.278107:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788211586.278146:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dd4f24a7 x1875075660779136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211586.278159:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd4f24a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660779136:0@lo:400: 00000100:00100000:2.0:1788211586.278270:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660779008 00000100:00100000:2.0:1788211586.278287:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660779008 00000100:00100000:2.0:1788211586.278319:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788211586.278325:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f921e212 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:3310:x1875075660779008:12345-0@lo:400: 00000100:00100000:2.0:1788211586.278362:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f921e212 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:3310:x1875075660779008:12345-0@lo:400: Request processed in 37us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211586.278368:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788211586.282918:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000722b50a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660779008:0@lo:400: 00000020:00000080:1.0:1788211586.941803:0:6323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9df28e70 20000000:00000080:1.0:1788211586.941825:0:6323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8abffdbb6000 uarg=0000000000000000 20000000:01000000:1.0:1788211586.941870:0:6323:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788211586.941879:0:6323:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788211586.941884:0:6323:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788211586.942324:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788211586.942338:0:6323:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788211586.948592:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788211586.951590:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788211586.951691:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788211586.954123:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788211586.954530:0:6323:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788211586.954552:0:6323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211586.954571:0:6323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c7c1ac07/0x2afbce82f55a52ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a52a6 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211586.954579:0:6323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211586.954620:0:6323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c7c1ac07/0x2afbce82f55a52ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a52a6 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211586.954634:0:6323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c7c1ac07/0x2afbce82f55a52ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a52a6 expref: 11 pid: 5838 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211586.954647:0:6323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6a6cc81 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1875075660779264:0@lo:104: 00000100:00100000:0.0:1788211586.954718:0:6323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211586.954791:0:6323:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079020bab going to sleep for 11 seconds 00000100:00100000:1.0:1788211586.954967:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660779264 00000100:00100000:1.0:1788211586.954974:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660779264 00000100:00100000:1.0:1788211586.955032:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788211586.955040:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000987bd601 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+3:6323:x1875075660779264:12345-0@lo:104: 00010000:00010000:1.0:1788211586.955052:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a52ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211586.955762:0:6323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6a6cc81 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1875075660779264:0@lo:104: 00010000:00010000:0.0:1788211586.955786:0:6323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211586.955838:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788211586.955850:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000987bd601 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+3:6323:x1875075660779264:12345-0@lo:104: Request processed in 810us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211586.955863:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788211586.955944:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788211586.955950:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a52ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.955958:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000033e562c9 already unused, calling callback (000000006f28ef8b) 10000000:00010000:1.0:1788211586.955961:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a52ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.955970:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a52ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788211586.955976:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a52ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211586.955982:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788211586.956060:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a52ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956067:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788211586.956104:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a52ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956110:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: 0000000033e562c9/0x2afbce82f55a52a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a52ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956124:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211586.956126:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211586.956127:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211586.956186:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003cef4792 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660779392:0@lo:103: 00000100:00100000:0.0:1788211586.956225:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211586.956322:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660779392 00000100:00100000:1.0:1788211586.956327:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660779392 00010000:00010000:1.0:1788211586.956345:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c7c1ac07/0x2afbce82f55a52ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a52a6 expref: 12 pid: 5838 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211586.956379:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788211586.956385:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6a6cc81 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+12:3308:x1875075660779392:12345-0@lo:103: 00010000:00010000:1.0:1788211586.956395:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211586.956399:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c7c1ac07/0x2afbce82f55a52ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a52a6 expref: 12 pid: 5838 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956409:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c7c1ac07/0x2afbce82f55a52ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a52a6 expref: 12 pid: 5838 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956421:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c7c1ac07/0x2afbce82f55a52ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a52a6 expref: 12 pid: 5838 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956433:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956445:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956457:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956463:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956470:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956475:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956480:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000917eff38 already unused, calling callback (00000000c752be12) 00010000:00010000:1.0:1788211586.956483:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956489:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956498:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211586.956506:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211586.956535:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6a6cc81 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+11:3308:x1875075660779392:12345-0@lo:103: Request processed in 151us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211586.956541:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788211586.956567:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003cef4792 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660779392:0@lo:103: 00010000:00010000:0.0:1788211586.956677:0:6323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211586.956684:0:6323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211586.956690:0:6323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000917eff38/0x2afbce82f55a52ec lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211587.237496:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211588.261404:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211589.286248:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211590.312762:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211591.333840:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788211591.397316:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788211591.397329:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfc288e800 from 1 10000000:01000000:3.0:1788211591.397336:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788211591.397390:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 000000007fa6600a/0x2afbce82f55a52f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211591.397404:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 000000007fa6600a/0x2afbce82f55a52f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211591.397414:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 000000007fa6600a/0x2afbce82f55a52f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211591.397440:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000500675a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660779520:0@lo:101: 00000100:00100000:3.0:1788211591.397519:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211591.397576:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000331e0c66 going to sleep for 11 seconds 00000100:00100000:2.0:1788211591.398360:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660779520 00000100:00100000:2.0:1788211591.398371:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660779520 00000100:00100000:2.0:1788211591.398431:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788211591.398440:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b578560a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+11:5840:x1875075660779520:12345-0@lo:101: 00010000:00010000:2.0:1788211591.398455:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211591.398473:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000581a5587/0x2afbce82f55a52fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a52f3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211591.398498:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000581a5587/0x2afbce82f55a52fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a52f3 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211591.398528:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000581a5587/0x2afbce82f55a52fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a52f3 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211591.398537:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000581a5587, rc 0) 00000100:00100000:2.0:1788211591.398603:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b578560a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:5840:x1875075660779520:12345-0@lo:101: Request processed in 163us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211591.398609:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788211591.398724:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000500675a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660779520:0@lo:101: 00010000:00010000:2.0:1788211591.398742:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 000000007fa6600a/0x2afbce82f55a52f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a52fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211591.398751:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 000000007fa6600a/0x2afbce82f55a52f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a52fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211591.398844:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000722b50a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660779648:0@lo:501: 00000100:00100000:2.0:1788211591.398872:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211591.398897:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cfaa762 going to sleep for 11 seconds 00000100:00100000:2.0:1788211591.398910:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660779648 00000100:00100000:2.0:1788211591.398913:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660779648 00000100:00100000:2.0:1788211591.398934:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788211591.398940:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000222ca26b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:5840:x1875075660779648:12345-0@lo:501: 00000100:00100000:2.0:1788211591.399239:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000222ca26b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:5840:x1875075660779648:12345-0@lo:501: Request processed in 299us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211591.399248:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788211591.399279:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000722b50a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660779648:0@lo:501: 00000100:00100000:2.0:1788211591.399303:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000722b50a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660779776:0@lo:503: 00000100:00100000:2.0:1788211591.399344:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211591.399359:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cfaa762 going to sleep for 11 seconds 00000100:00100000:2.0:1788211591.399371:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660779776 00000100:00100000:2.0:1788211591.399374:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660779776 00000100:00100000:2.0:1788211591.399392:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788211591.399397:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad43756b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:5840:x1875075660779776:12345-0@lo:503: 00000100:00100000:2.0:1788211591.399515:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad43756b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:5840:x1875075660779776:12345-0@lo:503: Request processed in 117us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211591.399522:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788211591.399561:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000722b50a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660779776:0@lo:503: 00000100:00100000:2.0:1788211591.399791:0:6572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000722b50a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:6572:1875075660779904:0@lo:502: 00000100:00100000:2.0:1788211591.399827:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211591.399846:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660779904 00000100:00100000:2.0:1788211591.399850:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660779904 00000100:00100000:2.0:1788211591.399873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788211591.399878:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa3f08bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:6572:x1875075660779904:12345-0@lo:502: 00000100:00100000:2.0:1788211591.399995:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa3f08bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:6572:x1875075660779904:12345-0@lo:502: Request processed in 116us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211591.400002:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788211591.400031:0:6572:0:(client.c:2715:ptlrpc_set_wait()) set 000000006bad2d11 going to sleep for 11 seconds 00000100:00100000:2.0:1788211591.400043:0:6572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000722b50a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:6572:1875075660779904:0@lo:502: 00000020:01000000:2.0:1788211591.400065:0:6572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211591.400075:0:6572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211591.400078:0:6572:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788211591.400085:0:6572:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abfc288e800 00000020:00000080:2.0:1788211591.400088:0:6572:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788211591.400139:0:6572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:6572:1875075660780032:0@lo:502: 00000100:00100000:2.0:1788211591.400191:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211591.400213:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660780032 00000100:00100000:2.0:1788211591.400216:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660780032 00000100:00100000:2.0:1788211591.400238:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788211591.400244:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:6572:x1875075660780032:12345-0@lo:502: 00000100:00100000:2.0:1788211591.400336:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:6572:x1875075660780032:12345-0@lo:502: Request processed in 91us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211591.400342:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788211591.400373:0:6572:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9cc900 going to sleep for 11 seconds 00000100:00100000:2.0:1788211591.400385:0:6572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:6572:1875075660780032:0@lo:502: 00000020:01000000:2.0:1788211591.400403:0:6572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211591.400407:0:6572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211591.400409:0:6572:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788211591.400412:0:6572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788211591.400467:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788211591.400485:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788211591.400494:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8ac0020c1a00/0x2afbce82f55a52f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a52fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211591.400504:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8ac0020c1a00/0x2afbce82f55a52f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a52fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211591.402956:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660780160:0@lo:400: 00000100:00100000:3.0:1788211591.403029:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211591.403104:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660780160 00000100:00100000:3.0:1788211591.403113:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660780160 00000100:00100000:3.0:1788211591.403161:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788211591.403202:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660780160:12345-0@lo:400: 00000100:00100000:3.0:1788211591.403256:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660780160:12345-0@lo:400: Request processed in 55us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211591.403264:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788211591.403716:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8abff6460e00 x1875075660780160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211591.403733:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660780160:0@lo:400: 00010000:00010000:2.0:1788211592.364468:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211593.382209:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788211593.969663:0:6691:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788211593.969668:0:6691:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788211593.969811:0:6691:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ac001fd6800 00000020:01000004:3.0:1788211593.969828:0:6691:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788211593.969843:0:6691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788211593.969861:0:6691:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8abfd2a999b8) 00000020:00000080:3.0:1788211593.969883:0:6691:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788211594.004503:0:6691:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788211594.004774:0:6691:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788211594.039976:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788211594.045844:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788211594.045879:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788211594.045937:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788211594.046116:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788211594.048473:0:6691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788211594.048486:0:6691:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788211594.048498:0:6691:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2afbce82f55a5308 00000020:01000004:3.0:1788211594.048507:0:6691:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788211594.048528:0:6691:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788211594.048532:0:6691:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788211594.048538:0:6691:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788211594.048542:0:6691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788211594.048555:0:6691:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8abfd2a9cd28) 00000020:00000080:3.0:1788211594.048565:0:6691:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788211594.049830:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211594.050058:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788211594.050064:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788211594.061889:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788211594.061902:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788211594.062517:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788211594.062525:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788211594.066886:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788211594.067487:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788211594.067495:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788211594.068670:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788211594.068681:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788211594.102439:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788211594.102728:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788211594.102736:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788211594.106505:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788211594.106522:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788211594.114388:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788211594.114417:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788211594.130542:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788211594.130906:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788211594.130913:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788211594.135440:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788211594.135461:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788211594.260528:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788211594.260780:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788211594.260788:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788211594.267662:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788211594.267685:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788211594.268998:0:6691:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788211594.269026:0:6691:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788211594.269032:0:6691:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788211594.306924:0:6691:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788211594.307127:0:6691:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.129@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788211594.307131:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788211594.307132:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788211594.307134:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211594.307135:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211594.307136:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211594.307137:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211594.307139:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788211594.307140:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788211594.307141:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788211594.307143:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211594.307144:0:6691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788211594.307148:0:6691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788211594.307151:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788211594.307152:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788211594.307153:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211594.307154:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211594.307155:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211594.307156:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211594.307157:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788211594.307158:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788211594.307159:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788211594.307160:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211594.307161:0:6691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788211594.307439:0:6691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788211594.307467:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6460e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660780288:0@lo:253: 00000100:00100000:3.0:1788211594.307560:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211594.307627:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff65749c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211594.307717:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660780288 00000100:00100000:2.0:1788211594.307726:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660780288 00000100:00100000:2.0:1788211594.307791:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788211594.307801:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:6691:x1875075660780288:12345-0@lo:253: 20000000:01000000:2.0:1788211594.307833:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788211594.307837:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788211594.307843:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788211594.307847:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788211594.308806:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788211594.309014:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788211594.309031:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788211594.309070:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788211594.309077:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788211594.309106:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788211594.309195:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788211594.309517:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788211594.309539:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.129@tcp 20000000:01000000:2.0:1788211594.309540:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.129@tcp (null) (null) (null) 00000040:00080000:2.0:1788211594.309573:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788211594.309580:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788211594.309638:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788211594.309647:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.129@tcp (null) (null) 00000040:00080000:2.0:1788211594.309697:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788211594.309707:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788211594.309749:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788211594.309803:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788211594.311063:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788211594.311090:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.129@tcp 20000000:01000000:2.0:1788211594.311093:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.129@tcp (null) (null) (null) 00000040:00080000:2.0:1788211594.311141:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788211594.311149:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788211594.311539:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788211594.311551:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.129@tcp (null) (null) 00000040:00080000:3.0:1788211594.311633:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788211594.311646:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788211594.311679:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788211594.311716:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788211594.311736:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788211594.311739:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788211594.311754:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788211594.311771:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788211594.311774:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788211594.311818:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788211594.311821:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788211594.313040:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788211594.313119:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788211594.313409:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788211594.313781:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788211594.313822:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788211594.314057:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788211594.314072:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788211594.314076:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788211594.315088:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788211594.315162:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788211594.315481:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788211594.316041:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788211594.316092:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788211594.316126:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788211594.316138:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788211594.316141:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788211594.316781:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788211594.317398:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788211594.317448:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788211594.317522:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788211594.317539:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788211594.317541:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788211594.317555:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788211594.317580:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.317611:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a522f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5228 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.317619:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a524b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5244 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.317626:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a52bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a52b4 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.317634:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.317701:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a52bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a52b4 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.317717:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a52bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a52b4 expref: 12 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211594.317732:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6460000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660780416:0@lo:104: 00000100:00100000:3.0:1788211594.317809:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788211594.317956:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a524b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5244 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.317964:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a524b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5244 expref: 12 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211594.317973:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660780544:0@lo:104: 00000100:00100000:3.0:1788211594.318000:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788211594.318397:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a522f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5228 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.318407:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a522f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5228 expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211594.318415:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6461f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660780672:0@lo:104: 00000100:00100000:3.0:1788211594.318438:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211594.318489:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660780416 00000100:00100000:0.0:1788211594.318497:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660780416 00000100:00100000:1.0:1788211594.318553:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660780544 00000100:00100000:1.0:1788211594.318557:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660780544 00000100:00100000:1.0:1788211594.318584:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788211594.318606:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+4:5836:x1875075660780416:12345-0@lo:104: 00010000:00010000:1.0:1788211594.318620:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a52b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a52bb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.318679:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788211594.318684:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+4:5836:x1875075660780416:12345-0@lo:104: Request processed in 92us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211594.318692:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788211594.318713:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788211594.318720:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6462a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+3:5836:x1875075660780544:12345-0@lo:104: 00010000:00010000:1.0:1788211594.318737:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4000/0x2afbce82f55a5244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a524b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.318776:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788211594.318781:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6462a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+3:5836:x1875075660780544:12345-0@lo:104: Request processed in 62us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211594.318787:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788211594.318807:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788211594.318813:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a52b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a52bb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.318820:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c0000 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788211594.318824:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a52b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a52bb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.318832:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a52b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a52bb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788211594.318839:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a52b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a52bb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211594.318845:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788211594.318873:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a52b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a52bb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.318879:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788211594.318913:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a52b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a52bb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.318920:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a52b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a52bb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.318940:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788211594.318952:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4000/0x2afbce82f55a5244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a524b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.318958:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4000 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788211594.318960:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4000/0x2afbce82f55a5244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a524b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.318966:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4000/0x2afbce82f55a5244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a524b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788211594.318972:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4000/0x2afbce82f55a5244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a524b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211594.318976:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788211594.318991:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4000/0x2afbce82f55a5244 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a524b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.318997:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788211594.319002:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4000/0x2afbce82f55a5244 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a524b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.319007:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4000/0x2afbce82f55a5244 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a524b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.319016:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211594.319018:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211594.319019:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211594.319039:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660780800:0@lo:103: 00000100:00100000:1.0:1788211594.319077:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211594.319102:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788211594.319108:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660780928:0@lo:103: 00000100:00100000:1.0:1788211594.319125:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211594.319155:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660780800 00000100:00100000:1.0:1788211594.319158:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660780800 00010000:00010000:2.0:1788211594.319361:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211594.319476:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a52bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a52b4 expref: 13 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211594.319504:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660780928 00000100:00100000:1.0:1788211594.319508:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660780928 00010000:00010000:1.0:1788211594.319522:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a524b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5244 expref: 14 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211594.319534:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788211594.319541:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+14:3310:x1875075660780800:12345-0@lo:103: 00010000:00010000:1.0:1788211594.319552:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211594.319557:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a52bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a52b4 expref: 14 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.319567:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a52bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a52b4 expref: 14 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.319584:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211594.319627:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+14:3310:x1875075660780800:12345-0@lo:103: Request processed in 86us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211594.319633:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788211594.319648:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788211594.319654:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+13:3310:x1875075660780928:12345-0@lo:103: 00010000:00010000:1.0:1788211594.319672:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211594.319676:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a524b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5244 expref: 13 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.319684:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a524b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5244 expref: 13 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.319693:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211594.319714:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+13:3310:x1875075660780928:12345-0@lo:103: Request processed in 61us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211594.319720:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788211594.319755:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660780928:0@lo:103: 00000100:00100000:1.0:1788211594.319763:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660780800:0@lo:103: 00000100:00100000:1.0:1788211594.320020:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660780672 00000100:00100000:1.0:1788211594.320026:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660780672 00000100:00100000:1.0:1788211594.320049:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788211594.320055:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+3:5836:x1875075660780672:12345-0@lo:104: 00010000:00010000:1.0:1788211594.320067:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a5228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a522f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211594.320143:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aa840 going to sleep for 11 seconds 00010000:00010000:3.0:1788211594.320164:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a52bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a52b4 expref: 12 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211594.320191:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6460000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660780416:0@lo:104: 00010000:00010000:1.0:1788211594.320288:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788211594.320295:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+3:5836:x1875075660780672:12345-0@lo:104: Request processed in 240us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211594.320302:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788211594.320359:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a524b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5244 expref: 11 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211594.320370:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660780544:0@lo:104: 00000100:00100000:3.0:1788211594.320378:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6461f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660780672:0@lo:104: 00010000:00010000:3.0:1788211594.320401:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.320607:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211594.320615:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a5228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a522f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.320623:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0031a00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:2.0:1788211594.320627:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a5228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a522f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.320636:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a5228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a522f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211594.320642:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a5228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a522f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211594.320648:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788211594.320726:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a5228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a522f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.320733:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788211594.320762:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a5228 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a522f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.320769:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a5228 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a522f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.320795:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211594.320797:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211594.320799:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211594.320859:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660781056:0@lo:103: 00000100:00100000:3.0:1788211594.320924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211594.321113:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660781056 00000100:00100000:2.0:1788211594.321119:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660781056 00010000:00010000:2.0:1788211594.321146:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a522f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5228 expref: 11 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211594.321190:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788211594.321210:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+11:3308:x1875075660781056:12345-0@lo:103: 00010000:00010000:2.0:1788211594.321222:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211594.321227:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a522f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5228 expref: 11 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321237:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a522f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5228 expref: 11 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321253:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a522f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5228 expref: 11 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321270:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321279:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321295:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321302:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321317:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321324:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321329:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c1200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211594.321334:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321342:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321356:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321364:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211594.321689:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+10:3308:x1875075660781056:12345-0@lo:103: Request processed in 479us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211594.321697:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788211594.321730:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321738:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.321744:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5316 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788211594.321760:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788211594.321884:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660781056:0@lo:103: 00010000:00010000:2.0:1788211594.405617:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211594.405672:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+9:6691:x1875075660780288:12345-0@lo:253: Request processed in 97866us (98105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211594.405686:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788211594.405847:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6460e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660780288:0@lo:253: 10000000:01000000:3.0:1788211594.405872:0:6691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788211594.405878:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788211594.405881:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788211594.405883:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211594.405884:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788211594.405886:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211594.406420:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211594.406425:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788211594.406427:0:6691:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788211594.406429:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211594.406432:0:6691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788211594.406462:0:6691:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ac001fd6800 from lustre-OST0000 10000000:01000000:3.0:1788211594.406629:0:6691:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788211594.406635:0:6691:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788211594.406645:0:6691:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8abfca8a4d28 local copy 10000000:01000000:3.0:1788211594.406651:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788211594.406707:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.406750:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.406765:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211594.406795:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6460e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660781184:0@lo:101: 00000100:00100000:3.0:1788211594.406875:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211594.407878:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b46480 going to sleep for 11 seconds 00000100:00100000:2.0:1788211594.410196:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660781184 00000100:00100000:2.0:1788211594.410212:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660781184 00000100:00100000:2.0:1788211594.411618:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788211594.411647:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+9:6691:x1875075660781184:12345-0@lo:101: 00010000:00010000:2.0:1788211594.411672:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211594.411702:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c5e00/0x2afbce82f55a5324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a531d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.411740:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c5e00/0x2afbce82f55a5324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a531d expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.411755:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c5e00/0x2afbce82f55a5324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a531d expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.411765:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c5e00, rc 0) 00000100:00100000:2.0:1788211594.411878:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+10:6691:x1875075660781184:12345-0@lo:101: Request processed in 245us (5005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211594.411886:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788211594.412014:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6460e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660781184:0@lo:101: 00010000:00010000:0.0:1788211594.412047:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2afbce82f55a5324 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211594.412056:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2afbce82f55a5324 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211594.412219:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660781312:0@lo:501: 00000100:00100000:0.0:1788211594.412255:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211594.419327:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6f456c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211594.421609:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660781312 00000100:00100000:3.0:1788211594.421629:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660781312 00000100:00100000:3.0:1788211594.421707:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788211594.421720:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+10:6691:x1875075660781312:12345-0@lo:501: 00000100:00100000:3.0:1788211594.422776:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+10:6691:x1875075660781312:12345-0@lo:501: Request processed in 1053us (10515us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788211594.422790:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788211594.429961:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660781312:0@lo:501: 10000000:01000000:0.0:1788211594.430117:0:6691:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788211594.430337:0:6691:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788211594.430348:0:6691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2afbce82f55a5324 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.430389:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2afbce82f55a5324 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.430396:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2afbce82f55a5324 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.430423:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788211594.430451:0:6691:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ac001fd6800 10000000:01000000:1.0:1788211594.430457:0:6691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788211594.430463:0:6691:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8abfca8a4d28 10000000:01000000:1.0:1788211594.430467:0:6691:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788211594.430470:0:6691:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8abfca8a4d28 from 1 10000000:01000000:1.0:1788211594.430473:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788211594.430494:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211594.430503:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2afbce82f55a5324 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.430514:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c0000 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:2.0:1788211594.430518:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2afbce82f55a5324 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.430520:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37a600/0x2afbce82f55a532b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.430534:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2afbce82f55a5324 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.430536:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfcb37a600/0x2afbce82f55a532b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.430555:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfcb37a600/0x2afbce82f55a532b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211594.430567:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2afbce82f55a5324 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211594.430575:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788211594.430583:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660781440:0@lo:101: 00010000:00010000:2.0:1788211594.430614:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2afbce82f55a5324 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.430622:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788211594.430662:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211594.430710:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104600 going to sleep for 11 seconds 00010000:00010000:2.0:1788211594.430756:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2afbce82f55a5324 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.430765:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a531d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2afbce82f55a5324 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.430783:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211594.430784:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211594.430786:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211594.431335:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211594.431352:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660781568:0@lo:103: 00000100:00100000:1.0:1788211594.431400:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211594.431485:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660781568 00000100:00100000:2.0:1788211594.431493:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660781568 00000100:00100000:3.0:1788211594.431515:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660781440 00000100:00100000:3.0:1788211594.431531:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660781440 00000100:00100000:2.0:1788211594.431556:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788211594.431569:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afe7852e-b478-4e21-8864-7e739fb0a137+11:3308:x1875075660781568:12345-0@lo:103: 00000100:00100000:3.0:1788211594.431575:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788211594.431585:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788211594.431586:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+11:6691:x1875075660781440:12345-0@lo:101: 00010000:00010000:3.0:1788211594.431609:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211594.431622:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c5e00/0x2afbce82f55a5324 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a531d expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.431624:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5332 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a532b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.431647:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5332 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a532b expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.431648:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788211594.431660:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5332 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a532b expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.431676:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac0020c1200, rc 0) 00000100:00100000:2.0:1788211594.431705:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afe7852e-b478-4e21-8864-7e739fb0a137+11:3308:x1875075660781568:12345-0@lo:103: Request processed in 139us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211594.431713:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788211594.431724:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+11:6691:x1875075660781440:12345-0@lo:101: Request processed in 139us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211594.431731:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788211594.432127:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660781568:0@lo:103: 00000100:00100000:1.0:1788211594.432844:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660781440:0@lo:101: 00010000:00010000:1.0:1788211594.432875:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfcb37a600/0x2afbce82f55a532b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5332 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.432896:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37a600/0x2afbce82f55a532b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5332 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211594.432918:0:6691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788211594.432937:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37a600/0x2afbce82f55a532b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5332 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.432945:0:6691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37a600/0x2afbce82f55a532b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5332 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211594.432955:0:6691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788211594.432962:0:6691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788211594.432969:0:6691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788211594.432972:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788211594.432998:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.433005:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.433013:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211594.433029:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660781696:0@lo:101: 00000100:00100000:1.0:1788211594.433090:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211594.433136:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104600 going to sleep for 11 seconds 00000100:00100000:3.0:1788211594.433148:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660781696 00000100:00100000:3.0:1788211594.433155:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660781696 00000100:00100000:3.0:1788211594.433210:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788211594.433220:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+10:6691:x1875075660781696:12345-0@lo:101: 00010000:00010000:3.0:1788211594.433231:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211594.433243:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a5340 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5339 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.433260:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a5340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5339 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.433269:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a5340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5339 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.433277:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac0020c0800, rc 0) 00000100:00100000:3.0:1788211594.433317:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+11:6691:x1875075660781696:12345-0@lo:101: Request processed in 99us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211594.433323:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788211594.433511:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660781696:0@lo:101: 00010000:00010000:1.0:1788211594.433589:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5340 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211594.433606:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5340 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211594.433721:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660781824:0@lo:501: 00000100:00100000:1.0:1788211594.433750:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211594.433780:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104600 going to sleep for 11 seconds 00000100:00100000:3.0:1788211594.433835:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660781824 00000100:00100000:3.0:1788211594.433840:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660781824 00000100:00100000:3.0:1788211594.433872:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788211594.433878:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+11:6691:x1875075660781824:12345-0@lo:501: 00000100:00100000:3.0:1788211594.434304:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+11:6691:x1875075660781824:12345-0@lo:501: Request processed in 424us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211594.434317:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788211594.434384:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660781824:0@lo:501: 00000100:00100000:1.0:1788211594.434488:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660781952:0@lo:503: 00000100:00100000:1.0:1788211594.434606:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211594.434631:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104600 going to sleep for 11 seconds 00000100:00100000:3.0:1788211594.434679:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660781952 00000100:00100000:3.0:1788211594.434684:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660781952 00000100:00100000:3.0:1788211594.434717:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788211594.434725:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+11:6691:x1875075660781952:12345-0@lo:503: 00000100:00100000:3.0:1788211594.437397:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+11:6691:x1875075660781952:12345-0@lo:503: Request processed in 2662us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211594.437671:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660781952:0@lo:503: 00000100:00100000:3.0:1788211594.438268:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000040:00080000:1.0:1788211594.439321:0:6691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788211594.439442:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782080:0@lo:502: 00000100:00100000:1.0:1788211594.439528:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211594.439573:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104600 going to sleep for 11 seconds 00000100:00100000:3.0:1788211594.439844:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660782080 00000100:00100000:3.0:1788211594.439854:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660782080 00000100:00100000:3.0:1788211594.439907:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788211594.439916:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+11:6691:x1875075660782080:12345-0@lo:502: 00000100:00100000:3.0:1788211594.440159:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+11:6691:x1875075660782080:12345-0@lo:502: Request processed in 243us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211594.440200:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788211594.440640:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782080:0@lo:502: 00000040:00080000:1.0:1788211594.440934:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788211594.440986:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788211594.441033:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788211594.441079:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788211594.441123:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788211594.441153:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788211594.441220:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782208:0@lo:502: 00000100:00100000:1.0:1788211594.441271:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211594.441310:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104600 going to sleep for 11 seconds 00000100:00100000:3.0:1788211594.441547:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660782208 00000100:00100000:3.0:1788211594.441554:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660782208 00000100:00100000:3.0:1788211594.441613:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788211594.441623:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+11:6691:x1875075660782208:12345-0@lo:502: 00000100:00100000:3.0:1788211594.441806:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+11:6691:x1875075660782208:12345-0@lo:502: Request processed in 184us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211594.441814:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788211594.441960:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782208:0@lo:502: 00000040:00080000:2.0:1788211594.442073:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788211594.442086:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788211594.443812:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788211594.443825:0:6710:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788211594.443834:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211594.443836:0:6710:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788211594.443843:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788211594.443862:0:6710:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8abfca8a3370) 00000020:00000080:2.0:1788211594.443888:0:6710:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788211594.443894:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788211594.443976:0:6710:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac001fd6800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788211594.443985:0:6710:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788211594.443992:0:6710:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2afbce82f55a534e 00010000:00010000:3.0:1788211594.450987:0:6710:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788211594.451848:0:6710:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788211594.459295:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788211594.459652:0:6710:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788211594.471872:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788211594.475867:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788211594.477857:0:6710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788211594.477873:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211594.477880:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211594.477883:0:6710:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788211594.477886:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211594.477891:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211594.477892:0:6710:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788211594.477896:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788211594.477897:0:6710:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788211594.477954:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211594.477957:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211594.477959:0:6710:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788211594.477962:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788211594.480313:0:6691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788211594.480355:0:6691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788211594.480382:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5340 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.480398:0:6691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5340 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211594.480407:0:6691:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ac001fd6800 from 1 10000000:01000000:2.0:1788211594.480411:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788211594.480457:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.480467:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.480493:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211594.480533:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782336:0@lo:101: 00000100:00100000:2.0:1788211594.480622:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211594.480682:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788211594.480712:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660782336 00000100:00100000:2.0:1788211594.480721:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660782336 00000100:00100000:2.0:1788211594.480772:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788211594.480782:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+11:6691:x1875075660782336:12345-0@lo:101: 00010000:00010000:2.0:1788211594.480796:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211594.480810:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4400/0x2afbce82f55a535c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5355 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.480836:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4400/0x2afbce82f55a535c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5355 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.480846:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c4400/0x2afbce82f55a535c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5355 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.480855:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4400, rc 0) 00000100:00100000:2.0:1788211594.480897:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:6691:x1875075660782336:12345-0@lo:101: Request processed in 116us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211594.480905:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788211594.480959:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782336:0@lo:101: 00010000:00010000:2.0:1788211594.480973:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a535c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.480993:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a535c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211594.481275:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782464:0@lo:501: 00000100:00100000:2.0:1788211594.481304:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211594.481329:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf68d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788211594.482915:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660782464 00000100:00100000:1.0:1788211594.482931:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660782464 00000100:00100000:1.0:1788211594.482984:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788211594.482994:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:6691:x1875075660782464:12345-0@lo:501: 00000100:00100000:1.0:1788211594.485929:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:6691:x1875075660782464:12345-0@lo:501: Request processed in 2925us (4612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211594.485945:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788211594.486661:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782464:0@lo:501: 00000100:00100000:2.0:1788211594.486712:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782592:0@lo:503: 00000100:00100000:2.0:1788211594.486764:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211594.486801:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf68d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788211594.486891:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660782592 00000100:00100000:3.0:1788211594.486906:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660782592 00000100:00100000:3.0:1788211594.486947:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788211594.486956:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:6691:x1875075660782592:12345-0@lo:503: 00000100:00100000:3.0:1788211594.487435:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:6691:x1875075660782592:12345-0@lo:503: Request processed in 478us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211594.487445:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788211594.493373:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782592:0@lo:503: 00000040:00080000:2.0:1788211594.493865:0:6691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788211594.493959:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782720:0@lo:502: 00000100:00100000:2.0:1788211594.497935:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211594.498189:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf68d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788211594.501441:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660782720 00000100:00100000:1.0:1788211594.501459:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660782720 00000100:00100000:1.0:1788211594.501534:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788211594.501546:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:6691:x1875075660782720:12345-0@lo:502: 00000100:00100000:1.0:1788211594.501905:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:6691:x1875075660782720:12345-0@lo:502: Request processed in 361us (3976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211594.501914:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788211594.502055:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782720:0@lo:502: 00000040:00080000:3.0:1788211594.502397:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788211594.502452:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788211594.502492:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782848:0@lo:502: 00000100:00100000:3.0:1788211594.502540:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211594.502577:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b46000 going to sleep for 11 seconds 00000100:00100000:1.0:1788211594.502891:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660782848 00000100:00100000:1.0:1788211594.502898:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660782848 00000100:00100000:1.0:1788211594.502943:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788211594.502952:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:6691:x1875075660782848:12345-0@lo:502: 00000100:00100000:1.0:1788211594.503144:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:6691:x1875075660782848:12345-0@lo:502: Request processed in 192us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211594.503151:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788211594.503464:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782848:0@lo:502: 00000040:00080000:3.0:1788211594.503589:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788211594.503612:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788211594.504829:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211594.504842:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211594.504844:0:6714:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788211594.504850:0:6714:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac001fd6800 00000020:00000080:0.0:1788211594.504853:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788211594.504874:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211594.504885:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211594.504886:0:6714:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788211594.504890:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788211594.505199:0:6691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788211594.505220:0:6691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788211594.505238:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a535c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.505250:0:6691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a535c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211594.505287:0:6691:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788211594.505290:0:6691:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ac001fd6800 10000000:01000000:3.0:1788211594.505294:0:6691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ac001fd6800 10000000:01000000:3.0:1788211594.505298:0:6691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788211594.505305:0:6691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ac001fd6800 from 1 10000000:01000000:3.0:1788211594.505313:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788211594.505349:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.505359:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.505369:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211594.505391:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782976:0@lo:101: 00000100:00100000:3.0:1788211594.505459:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211594.505496:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b46000 going to sleep for 11 seconds 00000100:00100000:2.0:1788211594.505807:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660782976 00000100:00100000:2.0:1788211594.505816:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660782976 00000100:00100000:2.0:1788211594.505867:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788211594.505877:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:6691:x1875075660782976:12345-0@lo:101: 00010000:00010000:2.0:1788211594.505891:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211594.505905:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a536a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5363 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.505933:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a536a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5363 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.505959:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a536a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5363 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.505969:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4600, rc 0) 00000100:00100000:2.0:1788211594.506269:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:6691:x1875075660782976:12345-0@lo:101: Request processed in 391us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211594.506276:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788211594.506671:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660782976:0@lo:101: 00010000:00010000:3.0:1788211594.506692:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a536a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.506703:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a536a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211594.506824:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660783104:0@lo:501: 00000100:00100000:3.0:1788211594.506858:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211594.506897:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b46000 going to sleep for 11 seconds 00000100:00100000:0.0:1788211594.507243:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660783104 00000100:00100000:0.0:1788211594.507250:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660783104 00000100:00100000:0.0:1788211594.507292:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788211594.507301:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+13:6691:x1875075660783104:12345-0@lo:501: 00000100:00100000:0.0:1788211594.507746:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+13:6691:x1875075660783104:12345-0@lo:501: Request processed in 444us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211594.507754:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788211594.507896:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660783104:0@lo:501: 00000100:00100000:3.0:1788211594.507940:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660783232:0@lo:503: 00000100:00100000:3.0:1788211594.507982:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211594.508149:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660783232 00000100:00100000:1.0:1788211594.508154:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660783232 00000100:00100000:1.0:1788211594.508223:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788211594.508231:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:6691:x1875075660783232:12345-0@lo:503: 00000100:00100000:1.0:1788211594.508384:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:6691:x1875075660783232:12345-0@lo:503: Request processed in 154us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211594.508391:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788211594.508556:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b46000 going to sleep for 11 seconds 00000100:00100000:3.0:1788211594.508570:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660783232:0@lo:503: 00000040:00080000:3.0:1788211594.508893:0:6691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788211594.508972:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660783360:0@lo:502: 00000100:00100000:3.0:1788211594.509232:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211594.509250:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b46000 going to sleep for 11 seconds 00000100:00100000:0.0:1788211594.509330:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660783360 00000100:00100000:0.0:1788211594.509337:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660783360 00000100:00100000:0.0:1788211594.509365:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788211594.509372:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+13:6691:x1875075660783360:12345-0@lo:502: 00000100:00100000:0.0:1788211594.509612:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+13:6691:x1875075660783360:12345-0@lo:502: Request processed in 240us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211594.509620:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788211594.510609:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660783360:0@lo:502: 00000040:00080000:3.0:1788211594.510958:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788211594.512231:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788211594.512279:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788211594.512343:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788211594.512374:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788211594.512412:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788211594.512440:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788211594.512469:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788211594.514544:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788211594.515034:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788211594.515075:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788211594.515152:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788211594.515254:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788211594.515291:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788211594.515356:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788211594.515395:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788211594.515428:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788211594.515556:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788211594.515672:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788211594.515712:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788211594.515763:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788211594.515881:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788211594.515916:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788211594.515967:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788211594.516005:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788211594.516041:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788211594.516107:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788211594.516145:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788211594.516223:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660783488:0@lo:502: 00000100:00100000:0.0:1788211594.516312:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211594.516365:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd87b2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788211594.516508:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660783488 00000100:00100000:1.0:1788211594.516516:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660783488 00000100:00100000:1.0:1788211594.516649:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788211594.516659:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+13:6691:x1875075660783488:12345-0@lo:502: 00000100:00100000:1.0:1788211594.517116:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+13:6691:x1875075660783488:12345-0@lo:502: Request processed in 457us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211594.517124:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788211594.520034:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660783488:0@lo:502: 00000040:00080000:0.0:1788211594.520253:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788211594.520271:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788211594.522338:0:6715:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788211594.522357:0:6715:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8abfca8a0000) 00000020:00000080:2.0:1788211594.522379:0:6715:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788211594.522499:0:6715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac001fd6800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788211594.522504:0:6715:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac001fd6800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788211594.522507:0:6715:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ac001fd6800 3 00010000:00080000:2.0:1788211594.522547:0:6715:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abec5afd800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.129@tcp at head 00010000:00010000:3.0:1788211594.530025:0:6715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788211594.530265:0:6715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788211594.530309:0:6715:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788211594.530321:0:6715:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2afbce82f55a5378 00000100:00080000:3.0:1788211594.530332:0:6715:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788211594.530338:0:6715:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8abec5afd800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1788211594.530371:0:6715:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abff6463480 x1875075660783616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788211594.530402:0:6715:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788211594.530498:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875075660783616:0@lo:38: 00000100:00100000:0.0:1788211594.530602:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211594.530674:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660783616 00000100:00100000:0.0:1788211594.530680:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660783616 00000100:00100000:0.0:1788211594.530719:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788211594.530727:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875075660783616:12345-0@lo:38: 00010000:00080000:0.0:1788211594.530750:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000100:00100000:2.0:1788211594.530808:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660783744:0@lo:400: 00000100:00100000:2.0:1788211594.530839:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211594.530878:0:5845:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788211594.530886:0:5845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788211594.530979:0:5843:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788211594.530988:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660783744 00000100:00100000:3.0:1788211594.530991:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660783744 00000100:00100000:3.0:1788211594.531025:0:5843:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788211594.531031:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000020:00000080:0.0:1788211594.531031:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2afbce82f55a537f 00000100:00100000:3.0:1788211594.531038:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660783744:12345-0@lo:400: 00000004:00100000:0.0:1788211594.531046:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788211594.531076:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8abfca9d2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788211594.531093:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660783744:12345-0@lo:400: Request processed in 55us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211594.531100:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788211594.531111:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875075660783616:12345-0@lo:38: Request processed in 384us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211594.531117:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788211594.531145:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8abff6463480 x1875075660783616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788211604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211594.531186:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788211594.531195:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788211594.531202:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788211594.531205:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788211594.531207:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec5afd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788211594.531213:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875075660783616:0@lo:38: 00000040:00080000:3.0:1788211594.531251:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:2.0:1788211594.531548:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8abfefac5f80 x1875075660783744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211594.531560:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660783744:0@lo:400: 00000020:01000000:0.0:1788211594.532343:0:6691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788211594.532373:0:6691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788211594.532387:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a536a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211594.532398:0:6691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a536a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788211594.532442:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788211594.532444:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788211594.532446:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788211594.532447:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788211594.532448:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788211594.532449:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788211594.532451:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788211594.532452:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788211594.532453:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788211594.532455:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788211594.532456:0:6691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788211594.532460:0:6691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788211594.532462:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788211594.532464:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788211594.532465:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788211594.532466:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788211594.532467:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788211594.532468:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788211594.532473:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788211594.532474:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788211594.532474:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788211594.532475:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788211594.532476:0:6691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788211594.532496:0:6691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788211594.532508:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660783872:0@lo:253: 00000100:00100000:0.0:1788211594.532965:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211594.533084:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660783872 00000100:00100000:2.0:1788211594.533093:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660783872 00000100:00100000:2.0:1788211594.533137:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788211594.533147:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:6691:x1875075660783872:12345-0@lo:253: 20000000:01000000:2.0:1788211594.533195:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788211594.533211:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788211594.534897:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd87b26c0 going to sleep for 11 seconds 20000000:01000000:0.0:1788211594.584161:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788211594.584202:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788211594.584312:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788211594.584318:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788211594.584379:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.584400:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a52de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a52d7 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.584419:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.584465:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a52de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a52d7 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.584480:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a52de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a52d7 expref: 13 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211594.584495:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6460000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1875075660784000:0@lo:104: 00000100:00100000:3.0:1788211594.584777:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211594.584837:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788211594.584930:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660784000 00000100:00100000:0.0:1788211594.584939:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660784000 00000100:00100000:0.0:1788211594.584990:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788211594.585001:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+3:5859:x1875075660784000:12345-0@lo:104: 00010000:00010000:0.0:1788211594.585023:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0c00/0x2afbce82f55a52d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a52de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211594.585083:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788211594.585090:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+3:5859:x1875075660784000:12345-0@lo:104: Request processed in 91us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211594.585097:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788211594.585134:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6460000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1875075660784000:0@lo:104: 00010000:00010000:0.0:1788211594.585155:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.588423:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211594.588443:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0c00/0x2afbce82f55a52d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a52de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.588460:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c0c00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211594.588465:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0c00/0x2afbce82f55a52d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a52de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.588475:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0c00/0x2afbce82f55a52d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a52de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211594.588482:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0c00/0x2afbce82f55a52d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a52de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211594.588510:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788211594.588581:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0c00/0x2afbce82f55a52d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a52de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.588589:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211594.588620:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0c00/0x2afbce82f55a52d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a52de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.588629:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0c00/0x2afbce82f55a52d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a52de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211594.588649:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211594.588651:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211594.588653:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211594.590247:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660784128:0@lo:103: 00000100:00100000:2.0:1788211594.590333:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211594.590416:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660784128 00000100:00100000:2.0:1788211594.590425:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660784128 00010000:00010000:2.0:1788211594.590656:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a52de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a52d7 expref: 14 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211594.590700:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788211594.590711:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+14:3311:x1875075660784128:12345-0@lo:103: 00010000:00010000:2.0:1788211594.590729:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211594.590736:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a52de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a52d7 expref: 14 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.590750:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a52de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a52d7 expref: 14 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.590844:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a52de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a52d7 expref: 14 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.590863:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.590870:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788211594.590891:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006573974s 00010000:00010000:2.0:1788211594.590896:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.590903:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.590910:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.590916:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.590923:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211594.590927:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.590935:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.590956:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211594.590962:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211594.590964:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788211594.590970:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211594.590984:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6062400/0x2afbce82f55a5386 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211594.591081:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+13:3311:x1875075660784128:12345-0@lo:103: Request processed in 371us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211594.591089:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788211594.591161:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660784128:0@lo:103: 00000100:00100000:0.0:1788211594.596266:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:6691:x1875075660783872:12345-0@lo:253: Request processed in 63110us (63292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211594.596281:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788211594.596399:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:6691:1875075660783872:0@lo:253: 10000000:01000000:2.0:1788211594.596447:0:6691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788211594.596452:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788211594.596454:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788211594.596455:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211594.596457:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211594.596458:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211594.596459:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211594.596461:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788211594.596463:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788211594.596464:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788211594.596466:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211594.596467:0:6691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788211594.596484:0:6691:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788211594.605963:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211594.606163:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788211594.606701:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211594.606892:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788211594.607310:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211594.607856:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788211594.609709:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788211594.895651:0:6691:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788211594.895659:0:6691:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788211594.895811:0:6691:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788211594.895885:0:6691:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788211594.895905:0:6691:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788211594.895934:0:6691:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788211595.438910:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211596.453999:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788211596.518887:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788211596.518905:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8abfc288e800 from 21 10000000:01000000:3.0:1788211596.518910:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788211596.518955:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211596.518967:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211596.518996:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211596.519019:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6461500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660784256:0@lo:101: 00000100:00100000:3.0:1788211596.519091:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211596.519154:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211596.519272:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660784256 00000100:00100000:1.0:1788211596.519280:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660784256 00000100:00100000:1.0:1788211596.519333:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788211596.519342:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:5840:x1875075660784256:12345-0@lo:101: 00010000:00010000:1.0:1788211596.519353:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211596.519366:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a5394 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a538d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211596.519388:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a5394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a538d expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211596.519398:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a5394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a538d expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211596.519423:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b200, rc 0) 00000100:00100000:1.0:1788211596.519461:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660784256:12345-0@lo:101: Request processed in 121us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211596.519467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788211596.519606:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6461500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660784256:0@lo:101: 00010000:00010000:0.0:1788211596.519620:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5394 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211596.519629:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5394 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211596.519680:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660784384:0@lo:501: 00000100:00100000:0.0:1788211596.519703:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211596.519732:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef2e0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788211596.519785:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660784384 00000100:00100000:1.0:1788211596.519789:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660784384 00000100:00100000:1.0:1788211596.519818:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788211596.519825:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660784384:12345-0@lo:501: 00000100:00100000:1.0:1788211596.520091:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660784384:12345-0@lo:501: Request processed in 266us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211596.520098:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788211596.520237:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660784384:0@lo:501: 00000100:00100000:0.0:1788211596.520271:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660784512:0@lo:503: 00000100:00100000:0.0:1788211596.520311:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211596.520332:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef2e0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788211596.521544:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660784512 00000100:00100000:1.0:1788211596.521570:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660784512 00000100:00100000:1.0:1788211596.521616:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788211596.521625:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660784512:12345-0@lo:503: 00000100:00100000:1.0:1788211596.521939:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660784512:12345-0@lo:503: Request processed in 314us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211596.521946:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788211596.523653:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660784512:0@lo:503: 00000100:00100000:0.0:1788211596.536158:0:6793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:6793:1875075660784640:0@lo:502: 00000100:00100000:0.0:1788211596.536979:0:6793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211596.537577:0:6793:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef2e0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788211596.544904:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660784640 00000100:00100000:2.0:1788211596.544923:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660784640 00000100:00100000:2.0:1788211596.545039:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788211596.545051:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:6793:x1875075660784640:12345-0@lo:502: 00000100:00100000:2.0:1788211596.545458:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:6793:x1875075660784640:12345-0@lo:502: Request processed in 406us (8479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211596.545466:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788211596.551896:0:6793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:6793:1875075660784640:0@lo:502: 00000100:00100000:0.0:1788211596.551994:0:6793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:6793:1875075660784768:0@lo:502: 00000100:00100000:0.0:1788211596.552090:0:6793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211596.552143:0:6793:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef2e0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788211596.552580:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660784768 00000100:00100000:1.0:1788211596.552589:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660784768 00000100:00100000:1.0:1788211596.552648:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788211596.552661:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:6793:x1875075660784768:12345-0@lo:502: 00000100:00100000:1.0:1788211596.552943:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:6793:x1875075660784768:12345-0@lo:502: Request processed in 285us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211596.552952:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788211596.553115:0:6793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:6793:1875075660784768:0@lo:502: 00000040:00080000:0.0:1788211596.553148:0:6793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788211596.553526:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788211596.553561:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788211596.553571:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5394 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211596.553583:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5394 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211596.553592:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788211596.553595:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8abfc288e800 from 4 10000000:01000000:1.0:1788211596.553598:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788211596.553633:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211596.553641:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211596.553649:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211596.553665:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660784896:0@lo:101: 00000100:00100000:1.0:1788211596.553705:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211596.553737:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6579240 going to sleep for 11 seconds 00000100:00100000:0.0:1788211596.553781:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660784896 00000100:00100000:0.0:1788211596.553787:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660784896 00000100:00100000:0.0:1788211596.553828:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788211596.553837:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660784896:12345-0@lo:101: 00010000:00010000:0.0:1788211596.553849:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211596.553866:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a53a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a539b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211596.553891:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a53a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a539b expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211596.553902:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a53a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a539b expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211596.553912:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030400, rc 0) 00000100:00100000:0.0:1788211596.553960:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660784896:12345-0@lo:101: Request processed in 124us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211596.553966:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788211596.554034:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660784896:0@lo:101: 00010000:00010000:2.0:1788211596.554048:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a53a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211596.554057:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a53a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211596.554109:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660785024:0@lo:256: 00000100:00100000:2.0:1788211596.554140:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211596.554197:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8449300 going to sleep for 11 seconds 00000100:00100000:1.0:1788211596.554268:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660785024 00000100:00100000:1.0:1788211596.554272:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660785024 00000100:00100000:1.0:1788211596.554304:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788211596.554311:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660785024:12345-0@lo:256: 20000000:01000000:1.0:1788211596.554324:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788211596.554341:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788211596.554343:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788211596.554541:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660785024:12345-0@lo:256: Request processed in 230us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211596.554562:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788211596.554620:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660785024:0@lo:256: 10000000:01000000:2.0:1788211596.554667:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788211596.554673:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a53a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211596.554680:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a53a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211596.554688:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788211596.554690:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788211596.554693:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788211596.554711:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211596.554719:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211596.554727:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211596.554739:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660785152:0@lo:101: 00000100:00100000:2.0:1788211596.554764:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211596.554788:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8449300 going to sleep for 11 seconds 00000100:00100000:1.0:1788211596.554891:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660785152 00000100:00100000:1.0:1788211596.554896:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660785152 00000100:00100000:1.0:1788211596.554929:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788211596.554936:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660785152:12345-0@lo:101: 00010000:00010000:1.0:1788211596.554945:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211596.554956:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a53b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a53a9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211596.554972:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a53b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a53a9 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211596.554981:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a53b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a53a9 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211596.554988:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b800, rc 0) 00000100:00100000:1.0:1788211596.555017:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660785152:12345-0@lo:101: Request processed in 82us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211596.555023:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788211596.555134:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660785152:0@lo:101: 00010000:00010000:2.0:1788211596.555145:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a53b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211596.555153:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a53b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211596.555683:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660785280:0@lo:501: 00000100:00100000:2.0:1788211596.555719:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211596.555787:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8449300 going to sleep for 11 seconds 00000100:00100000:1.0:1788211596.562839:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660785280 00000100:00100000:1.0:1788211596.562860:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660785280 00000100:00100000:1.0:1788211596.563588:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788211596.563603:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660785280:12345-0@lo:501: 00000100:00100000:1.0:1788211596.563955:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660785280:12345-0@lo:501: Request processed in 355us (8234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211596.563964:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788211596.568119:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660785280:0@lo:501: 00000100:00100000:2.0:1788211596.568205:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660785408:0@lo:503: 00000100:00100000:2.0:1788211596.568290:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211596.568336:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8449300 going to sleep for 11 seconds 00000100:00100000:0.0:1788211596.568437:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660785408 00000100:00100000:0.0:1788211596.568445:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660785408 00000100:00100000:0.0:1788211596.568492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788211596.568509:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660785408:12345-0@lo:503: 00000100:00100000:0.0:1788211596.568795:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660785408:12345-0@lo:503: Request processed in 286us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211596.568804:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788211596.569625:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660785408:0@lo:503: 00000100:00100000:0.0:1788211596.571514:0:6797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:6797:1875075660785536:0@lo:502: 00000100:00100000:0.0:1788211596.571608:0:6797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211596.571657:0:6797:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef2e0900 going to sleep for 11 seconds 00000100:00100000:2.0:1788211596.571720:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660785536 00000100:00100000:2.0:1788211596.571729:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660785536 00000100:00100000:2.0:1788211596.571782:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788211596.571793:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:6797:x1875075660785536:12345-0@lo:502: 00000100:00100000:2.0:1788211596.572122:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:6797:x1875075660785536:12345-0@lo:502: Request processed in 330us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211596.572131:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788211596.572385:0:6797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:6797:1875075660785536:0@lo:502: 00000020:01000000:0.0:1788211596.572433:0:6797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788211596.572441:0:6797:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788211596.572449:0:6797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211596.572451:0:6797:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788211596.572456:0:6797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788211596.572460:0:6797:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.129@tcp to nid 0x20000c0a8cc81 (192.168.204.129@tcp) 00000020:01000000:0.0:1788211596.572483:0:6797:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788211596.572485:0:6797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788211596.572500:0:6797:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8abfd2a1cd28) 00000020:00000080:0.0:1788211596.572522:0:6797:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788211596.572528:0:6797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788211596.572630:0:6797:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788211596.572636:0:6797:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788211596.572644:0:6797:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a53be 00010000:00080000:0.0:1788211596.572674:0:6797:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abfd86dd000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:0.0:1788211596.572891:0:6797:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788211596.655473:0:6797:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788211596.655502:0:6797:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788211596.656505:0:6797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788211596.656711:0:6797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788211596.656779:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788211596.656850:0:6797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788211596.657906:0:6801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788211596.657912:0:6801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788211596.658750:0:6797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788211596.658765:0:6797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788211596.658813:0:6797:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788211596.658834:0:6797:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a53c5 00000100:00080000:1.0:1788211596.658845:0:6797:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788211596.658851:0:6797:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8abfd86dd000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211596.658890:0:6797:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfca8b7100 x1875075660785664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788211596.658958:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660785664:0@lo:8: 00000100:00100000:2.0:1788211596.659047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788211596.659244:0:6797:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788211596.659346:0:6797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211596.659351:0:6797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211596.659353:0:6797:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788211596.659356:0:6797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788211596.659360:0:6797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211596.659361:0:6797:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788211596.659364:0:6797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788211596.659366:0:6797:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788211596.659390:0:6797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:6797:1875075660785792:0@lo:502: 00000100:00100000:1.0:1788211596.659437:0:6797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211596.659480:0:6797:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6579e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211596.659585:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660785792 00000100:00100000:2.0:1788211596.659592:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660785792 00000100:00100000:2.0:1788211596.659631:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788211596.659640:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:6797:x1875075660785792:12345-0@lo:502: 00000100:00100000:2.0:1788211596.659887:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:6797:x1875075660785792:12345-0@lo:502: Request processed in 247us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211596.659901:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788211596.662358:0:6797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:6797:1875075660785792:0@lo:502: 00000020:01000000:1.0:1788211596.662403:0:6797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211596.662412:0:6797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211596.662414:0:6797:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788211596.662419:0:6797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1788211596.662825:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660786048:0@lo:400: 00000100:00100000:0.0:1788211596.662891:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211596.662930:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788211596.662936:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660785920:0@lo:400: 00000100:00100000:0.0:1788211596.662962:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211596.663005:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660786048 00000100:00100000:0.0:1788211596.663012:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660786048 00000100:00100000:0.0:1788211596.663061:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660785920 00000100:00100000:0.0:1788211596.663064:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660785920 00000100:00100000:0.0:1788211596.663082:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788211596.663091:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660786048:12345-0@lo:400: 00000100:00100000:0.0:1788211596.663140:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660786048:12345-0@lo:400: Request processed in 50us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211596.663147:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788211596.663162:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788211596.663197:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660785920:12345-0@lo:400: 00000100:00100000:0.0:1788211596.663225:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660785920:12345-0@lo:400: Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211596.663231:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788211596.663265:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abffdb91f80 x1875075660785920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211596.663277:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660785920:0@lo:400: 00010000:00080000:0.0:1788211596.663288:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abffdb93100 x1875075660786048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211596.663296:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660786048:0@lo:400: 00000100:00080000:1.0:1788211596.663485:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211596.663673:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660785664 00000100:00100000:3.0:1788211596.663679:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660785664 00000100:00100000:3.0:1788211596.663712:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788211596.663717:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875075660785664:12345-0@lo:8: 00010000:00080000:3.0:1788211596.663745:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1788211596.663779:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a53cc 00002000:00100000:3.0:1788211596.663821:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8abec5adf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788211596.663826:0:6693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788211596.663830:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788211596.664082:0:6693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:0.0:1788211596.664268:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788211596.664297:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788211596.664309:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a53b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211596.664320:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a53b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211596.664330:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788211596.664333:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8abfca8a4d28 from 1 10000000:01000000:0.0:1788211596.664336:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788211596.664366:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211596.664374:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211596.664382:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211596.664400:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660786176:0@lo:101: 00000100:00100000:0.0:1788211596.664455:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211596.664495:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef2e0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788211596.664546:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660786176 00000100:00100000:1.0:1788211596.664561:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660786176 00000100:00100000:1.0:1788211596.664604:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788211596.664612:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660786176:12345-0@lo:101: 00010000:00010000:1.0:1788211596.664623:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211596.664646:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37b000/0x2afbce82f55a53da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a53d3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211596.664669:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37b000/0x2afbce82f55a53da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a53d3 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211596.664680:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37b000/0x2afbce82f55a53da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a53d3 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211596.664689:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b000, rc 0) 00000100:00100000:1.0:1788211596.664724:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660786176:12345-0@lo:101: Request processed in 114us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211596.664731:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00002000:00080000:3.0:1788211596.664867:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788211596.664893:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8abec5ade800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788211596.664962:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660786176:0@lo:101: 00010000:00010000:0.0:1788211596.665053:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a53da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211596.665064:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a53da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211596.665127:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660786304:0@lo:501: 00000100:00100000:0.0:1788211596.665157:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211596.665203:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef2e0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788211596.665262:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660786304 00000100:00100000:1.0:1788211596.665267:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660786304 00000100:00100000:1.0:1788211596.665298:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788211596.665305:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660786304:12345-0@lo:501: 00000100:00100000:1.0:1788211596.665543:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660786304:12345-0@lo:501: Request processed in 238us (385us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788211596.665560:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788211596.666114:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875075660785664:12345-0@lo:8: Request processed in 2392us (7063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211596.666124:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788211596.666256:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660786304:0@lo:501: 10000000:01000000:0.0:1788211596.666292:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788211596.666301:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a53da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211596.666310:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a53da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788211596.666403:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfca8b7100 x1875075660785664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788211606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211596.666413:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788211596.666421:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788211596.666429:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788211596.666434:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788211596.666437:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfd86dd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788211596.666458:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788211596.666471:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660785664:0@lo:8: 00000004:00080000:2.0:1788211596.666804:0:6801:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788211596.666905:0:6801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 185972737967ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788211596.712645:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788211596.712810:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660786432:0@lo:13: 00000100:00100000:0.0:1788211596.712966:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211596.713072:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660786432 00000100:00100000:1.0:1788211596.713080:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660786432 00000100:00100000:1.0:1788211596.713135:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788211596.713144:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660786432:12345-0@lo:13: 00002000:00000024:1.0:1788211596.713197:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:2.0:1788211596.713276:0:6802:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788211596.713300:0:6802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1875075660786560:0@lo:7: 00000100:00100000:2.0:1788211596.713330:0:6802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211596.713349:0:6802:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca273b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788211596.713572:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660786432:12345-0@lo:13: Request processed in 428us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211596.713581:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788211596.713603:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788211596.713655:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfefac5180 x1875075660786432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211596.713674:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660786432:0@lo:13: 00000100:00100000:0.0:1788211596.713702:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660786560 00000100:00100000:0.0:1788211596.713706:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660786560 00000100:00100000:0.0:1788211596.713737:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788211596.713744:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6802:x1875075660786560:12345-0@lo:7: 00002000:00080000:1.0:1788211596.733143:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788211596.733153:0:6696:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788211596.733294:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6802:x1875075660786560:12345-0@lo:7: Request processed in 19545us (19958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211596.733310:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788211596.733515:0:6802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfefac6300 x1875075660786560/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788211612 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211596.733529:0:6802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1875075660786560:0@lo:7: 00000004:00080000:2.0:1788211596.733544:0:6802:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788211596.733606:0:6802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1875075660786688:0@lo:5: 00000100:00100000:2.0:1788211596.733645:0:6802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211596.733688:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660786688 00000100:00100000:3.0:1788211596.733696:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660786688 00000100:00100000:2.0:1788211596.733700:0:6802:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca273b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788211596.733750:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788211596.733760:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6802:x1875075660786688:12345-0@lo:5: 00002000:00080000:3.0:1788211596.733791:0:6693:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788211596.733803:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788211596.734085:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6802:x1875075660786688:12345-0@lo:5: Request processed in 325us (439us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788211596.734092:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788211596.734847:0:6802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfefac6300 x1875075660786688/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788211612 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211596.734863:0:6802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1875075660786688:0@lo:5: 00000004:00080000:0.0:1788211596.734875:0:6802:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788211596.734916:0:6802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1875075660786816:0@lo:700: 00000100:00100000:0.0:1788211596.734954:0:6802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211596.734991:0:6802:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4ad9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788211596.735047:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660786816 00000100:00100000:3.0:1788211596.735053:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660786816 00000100:00100000:3.0:1788211596.735096:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788211596.735104:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6802:x1875075660786816:12345-0@lo:700: 00000100:00100000:3.0:1788211596.735137:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6702:1875075660786944:0@lo:700: 00000100:00100000:3.0:1788211596.735192:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211596.735220:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b46000 going to sleep for 11 seconds 00000100:00100000:1.0:1788211596.735248:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660786944 00000100:00100000:1.0:1788211596.735253:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660786944 00000100:00100000:1.0:1788211596.735288:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788211596.735296:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6702:x1875075660786944:12345-0@lo:700: 40000000:02000000:1.0:1788211596.827886:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788211596.837343:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6702:x1875075660786944:12345-0@lo:700: Request processed in 102041us (102143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211596.837363:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788211596.837484:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abff6462680 x1875075660786944/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788211612 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211596.837501:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6702:1875075660786944:0@lo:700: 40000000:02000000:1.0:1788211596.837516:0:6702:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1788211596.948260:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6802:x1875075660786816:12345-0@lo:700: Request processed in 213147us (213295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211596.948281:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:2.0:1788211596.948337:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788211596.948346:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1788211596.948478:0:6802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abffdb91f80 x1875075660786816/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788211612 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211596.948495:0:6802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1875075660786816:0@lo:700: 00000004:02000040:0.0:1788211597.000906:0:6802:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788211597.013098:0:6802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1875075660787072:0@lo:5: 00000100:00100000:0.0:1788211597.013209:0:6802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211597.013265:0:6802:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b46000 going to sleep for 11 seconds 00000100:00100000:1.0:1788211597.013555:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660787072 00000100:00100000:1.0:1788211597.013564:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660787072 00000100:00100000:1.0:1788211597.013636:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788211597.013647:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6802:x1875075660787072:12345-0@lo:5: 00002000:00080000:1.0:1788211597.021127:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788211597.021149:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788211597.024619:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6802:x1875075660787072:12345-0@lo:5: Request processed in 10967us (11403us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788211597.024633:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788211597.025142:0:6802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abffdb91f80 x1875075660787072/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788211613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211597.025156:0:6802:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788211597.025186:0:6802:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8abffdb91f80 x1875075660787072/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788211613 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211597.025198:0:6802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1875075660787072:0@lo:5: 00000004:00080000:2.0:1788211597.025219:0:6802:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788211597.478781:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211598.502028:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211599.533274:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211600.550584:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211601.573369:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788211601.955910:0:7063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788211602.150353:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660787200:0@lo:400: 00000100:00100000:3.0:1788211602.150442:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211602.150470:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660787584:0@lo:400: 00000100:00100000:0.0:1788211602.150508:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211602.150540:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660787456:0@lo:400: 00000100:00100000:0.0:1788211602.150568:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211602.150604:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788211602.150610:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660787328:0@lo:400: 00000100:00100000:0.0:1788211602.150632:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211602.150698:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660787200 00000100:00100000:0.0:1788211602.150706:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660787200 00000100:00100000:0.0:1788211602.150751:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788211602.150760:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+16:3311:x1875075660787200:12345-0@lo:400: 00000100:00100000:0.0:1788211602.150869:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+16:3311:x1875075660787200:12345-0@lo:400: Request processed in 109us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211602.150877:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788211602.150911:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660787584 00000100:00100000:0.0:1788211602.150915:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660787584 00000100:00100000:0.0:1788211602.150951:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788211602.150958:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660787584:12345-0@lo:400: 00000100:00100000:0.0:1788211602.151001:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660787584:12345-0@lo:400: Request processed in 45us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211602.151008:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788211602.151028:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660787456 00000100:00100000:0.0:1788211602.151031:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660787456 00000100:00100000:0.0:1788211602.151055:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660787328 00000100:00100000:0.0:1788211602.151057:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660787328 00000100:00100000:0.0:1788211602.151075:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788211602.151081:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660787456:12345-0@lo:400: 00000100:00100000:3.0:1788211602.151156:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788211602.151187:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660787328:12345-0@lo:400: 00000100:00100000:3.0:1788211602.151225:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660787328:12345-0@lo:400: Request processed in 62us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211602.151241:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788211602.151250:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660787456:12345-0@lo:400: Request processed in 169us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211602.151255:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788211602.151369:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abff6462300 x1875075660787584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211602.151384:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660787584:0@lo:400: 00010000:00080000:0.0:1788211602.151457:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abff6462680 x1875075660787328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211602.151482:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660787328:0@lo:400: 00010000:00080000:0.0:1788211602.151495:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abff6461500 x1875075660787456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211602.151512:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660787456:0@lo:400: 00000100:00100000:0.0:1788211602.151623:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660787200:0@lo:400: 00000100:00080000:1.0:1788211602.152894:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788211602.152903:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211602.152911:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788211602.152929:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660787712:0@lo:13: 00000100:00100000:1.0:1788211602.153000:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211602.153428:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660787712 00000100:00100000:3.0:1788211602.153439:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660787712 00000100:00100000:3.0:1788211602.153501:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788211602.153510:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660787712:12345-0@lo:13: 00002000:00000024:3.0:1788211602.153552:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211602.153751:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660787712:12345-0@lo:13: Request processed in 241us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211602.153760:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788211602.156279:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfca8b7100 x1875075660787712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211602.156326:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660787712:0@lo:13: 00000001:00080000:2.0:1788211602.270965:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788211602.598746:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211603.625355:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211604.645690:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211605.669611:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211606.699243:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211607.272662:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660787840:0@lo:400: 00000100:00100000:3.0:1788211607.272793:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660788224:0@lo:400: 00000100:00100000:3.0:1788211607.272837:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211607.272913:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788211607.272915:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211607.272918:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660788096:0@lo:400: 00000100:00100000:3.0:1788211607.272964:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211607.272996:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660788224 00000100:00100000:3.0:1788211607.273003:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660788224 00000100:00100000:0.0:1788211607.273036:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211607.273041:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660787968:0@lo:400: 00000100:00100000:3.0:1788211607.273058:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788211607.273064:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211607.273067:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660788224:12345-0@lo:400: 00000100:00100000:3.0:1788211607.273121:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660788224:12345-0@lo:400: Request processed in 55us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211607.273129:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788211607.273151:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660788096 00000100:00100000:3.0:1788211607.273154:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660788096 00000100:00100000:3.0:1788211607.273197:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660787968 00000100:00100000:3.0:1788211607.273200:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660787968 00000100:00100000:0.0:1788211607.273200:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660787840 00000100:00100000:0.0:1788211607.273203:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660787840 00000100:00100000:3.0:1788211607.273218:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788211607.273224:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660788096:12345-0@lo:400: 00000100:00100000:0.0:1788211607.273224:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788211607.273229:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc923a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+16:3308:x1875075660787840:12345-0@lo:400: 00000100:00100000:3.0:1788211607.273254:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660788096:12345-0@lo:400: Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211607.273257:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc923a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+16:3308:x1875075660787840:12345-0@lo:400: Request processed in 28us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211607.273260:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788211607.273262:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788211607.273270:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788211607.273276:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660787968:12345-0@lo:400: 00000100:00100000:3.0:1788211607.273301:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660787968:12345-0@lo:400: Request processed in 25us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211607.273306:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788211607.273320:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788211607.273334:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788211607.273376:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abffdb91880 x1875075660788096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211607.273389:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660788096:0@lo:400: 00010000:00080000:3.0:1788211607.273398:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abffdb90e00 x1875075660788224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211607.273405:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788211607.273419:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660788224:0@lo:400: 00010000:00080000:0.0:1788211607.273597:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abffdb90000 x1875075660787968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211607.273606:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660787968:0@lo:400: 00000100:00100000:0.0:1788211607.273615:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660787840:0@lo:400: 00000100:00100000:0.0:1788211607.274297:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660788352:0@lo:13: 00000100:00100000:0.0:1788211607.274343:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211607.274590:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660788352 00000100:00100000:2.0:1788211607.274596:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660788352 00000100:00100000:2.0:1788211607.274634:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788211607.274641:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660788352:12345-0@lo:13: 00002000:00000024:2.0:1788211607.274670:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211607.274719:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660788352:12345-0@lo:13: Request processed in 78us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211607.274726:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788211607.278657:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfca8b7100 x1875075660788352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211607.278688:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660788352:0@lo:13: 00010000:00010000:3.0:1788211607.726146:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211608.742376:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211609.775120:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211610.789791:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211611.813950:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211612.394576:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660788480:0@lo:400: 00000100:00100000:2.0:1788211612.394663:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211612.394725:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788211612.394731:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660788864:0@lo:400: 00000100:00100000:2.0:1788211612.394758:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211612.394788:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660788608:0@lo:400: 00000100:00100000:2.0:1788211612.394814:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211612.394833:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788211612.394838:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660788736:0@lo:400: 00000100:00100000:2.0:1788211612.394862:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211612.394894:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660788480 00000100:00100000:2.0:1788211612.394903:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660788480 00000100:00100000:2.0:1788211612.394955:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788211612.394965:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+16:3309:x1875075660788480:12345-0@lo:400: 00000100:00100000:2.0:1788211612.395029:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+16:3309:x1875075660788480:12345-0@lo:400: Request processed in 66us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211612.395037:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788211612.395089:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660788864 00000100:00100000:2.0:1788211612.395093:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660788864 00000100:00100000:2.0:1788211612.395129:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788211612.395136:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660788864:12345-0@lo:400: 00000100:00100000:2.0:1788211612.395219:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660788864:12345-0@lo:400: Request processed in 84us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211612.395226:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788211612.395254:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660788608 00000100:00100000:2.0:1788211612.395257:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660788608 00000100:00100000:2.0:1788211612.395281:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660788736 00000100:00100000:2.0:1788211612.395284:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660788736 00000100:00100000:2.0:1788211612.395306:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788211612.395313:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660788608:12345-0@lo:400: 00000100:00100000:2.0:1788211612.395348:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660788608:12345-0@lo:400: Request processed in 36us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211612.395354:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788211612.395365:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788211612.395371:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660788736:12345-0@lo:400: 00000100:00100000:2.0:1788211612.395397:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660788736:12345-0@lo:400: Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211612.395403:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788211612.395426:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788211612.395430:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788211612.395479:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfefac7800 x1875075660788736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211612.395501:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660788736:0@lo:400: 00010000:00080000:2.0:1788211612.395516:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfefac4a80 x1875075660788608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211612.395525:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660788608:0@lo:400: 00010000:00080000:2.0:1788211612.395555:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfefac4380 x1875075660788864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211612.395564:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660788864:0@lo:400: 00000100:00100000:2.0:1788211612.395573:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660788480:0@lo:400: 00000100:00100000:2.0:1788211612.406205:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211612.406259:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660788992:0@lo:13: 00000100:00100000:2.0:1788211612.406339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211612.406395:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660788992 00000100:00100000:2.0:1788211612.406403:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660788992 00000100:00100000:2.0:1788211612.406466:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788211612.406475:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660788992:12345-0@lo:13: 00002000:00000024:2.0:1788211612.406515:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211612.406559:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660788992:12345-0@lo:13: Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211612.406566:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788211612.406610:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfefac6300 x1875075660788992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211612.406627:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660788992:0@lo:13: 00010000:00010000:0.0:1788211612.837869:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211613.862364:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211614.887219:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788211615.510865:0:7638:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788211615.510870:0:7638:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788211615.511024:0:7638:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8abfcaf32000 00000020:01000004:3.0:1788211615.511040:0:7638:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788211615.511053:0:7638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788211615.511079:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8abff7024d28) 00000020:00000080:3.0:1788211615.511104:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788211615.535791:0:7638:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788211615.536849:0:7638:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788211615.570464:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788211615.579411:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788211615.579447:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788211615.579504:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788211615.579529:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788211615.579911:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788211615.579924:0:7638:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788211615.579937:0:7638:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2afbce82f55a53e8 00000020:01000004:3.0:1788211615.579945:0:7638:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788211615.579967:0:7638:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788211615.579971:0:7638:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788211615.579978:0:7638:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788211615.580000:0:7638:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788211615.580004:0:7638:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788211615.621254:0:7638:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788211615.621297:0:7638:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.129@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788211615.621302:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788211615.621303:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788211615.621304:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211615.621306:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211615.621307:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211615.621308:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211615.621310:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788211615.621312:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788211615.621313:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788211615.621315:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211615.621316:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788211615.621321:0:7638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788211615.621323:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788211615.621324:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788211615.621326:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211615.621327:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211615.621328:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211615.621329:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211615.621330:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788211615.621331:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788211615.621332:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788211615.621333:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211615.621334:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788211615.621369:0:7638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788211615.621390:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660789120:0@lo:253: 00000100:00100000:2.0:1788211615.621473:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211615.622075:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660789120 00000100:00100000:0.0:1788211615.622083:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660789120 00000100:00100000:0.0:1788211615.622145:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788211615.622155:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+16:7638:x1875075660789120:12345-0@lo:253: 20000000:01000000:0.0:1788211615.622217:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788211615.622222:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788211615.622228:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788211615.622232:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788211615.623426:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788211615.623653:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788211615.623670:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788211615.623714:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788211615.623725:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788211615.623754:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788211615.623800:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788211615.624267:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788211615.624292:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.129@tcp 20000000:01000000:0.0:1788211615.624294:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.129@tcp (null) (null) (null) 00000040:00080000:0.0:1788211615.624329:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788211615.624338:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788211615.624397:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788211615.624407:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.129@tcp (null) (null) 00000040:00080000:0.0:1788211615.624440:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788211615.624450:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788211615.624480:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788211615.624530:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000100:00100000:3.0:1788211615.625703:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc6480 going to sleep for 11 seconds 00000040:00080000:1.0:1788211615.626538:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788211615.626565:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.129@tcp 20000000:01000000:1.0:1788211615.626568:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.129@tcp (null) (null) (null) 00000040:00080000:1.0:1788211615.626744:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788211615.626754:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788211615.626787:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788211615.626793:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.129@tcp (null) (null) 00000040:00080000:1.0:1788211615.626819:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788211615.626840:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788211615.626891:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788211615.626930:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788211615.626947:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788211615.626950:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788211615.626953:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788211615.626965:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788211615.626967:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788211615.626999:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788211615.627002:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788211615.627911:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788211615.628632:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788211615.628679:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788211615.628748:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788211615.628764:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788211615.628767:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788211615.629470:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788211615.629560:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788211615.629739:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788211615.630000:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788211615.630036:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788211615.630124:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788211615.630139:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788211615.630141:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788211615.631018:0:7642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788211615.631895:0:7642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788211615.631981:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788211615.634027:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788211615.634092:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788211615.634128:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788211615.634147:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788211615.634151:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788211615.636496:0:7643:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788211615.640244:0:7643:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788211615.640293:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788211615.640712:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788211615.640761:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788211615.640831:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1788211615.640849:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788211615.640851:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788211615.640861:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788211615.640882:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.640925:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a5340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5339 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.640932:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a536a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5363 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.640939:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a5394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a538d expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.640945:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a53b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a53a9 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.640952:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfcb37b000/0x2afbce82f55a53da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a53d3 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.640959:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.641003:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfcb37b000/0x2afbce82f55a53da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a53d3 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.641020:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfcb37b000/0x2afbce82f55a53da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a53d3 expref: 16 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211615.641036:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660789248:0@lo:104: 00000100:00100000:2.0:1788211615.641105:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788211615.641153:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a53b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a53a9 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.641161:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a53b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a53a9 expref: 16 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211615.641221:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660789376:0@lo:104: 00010000:00010000:2.0:1788211615.641252:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a5394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a538d expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.641259:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a5394 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a538d expref: 16 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211615.641266:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660789504:0@lo:104: 00010000:00010000:2.0:1788211615.641305:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a536a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5363 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.641314:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a536a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5363 expref: 16 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211615.641323:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660789632:0@lo:104: 00010000:00010000:2.0:1788211615.641345:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a5340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5339 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.641351:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a5340 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5339 expref: 16 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211615.641358:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660789760:0@lo:104: 00000100:00100000:2.0:1788211615.641375:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211615.641960:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788211615.641985:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211615.642016:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211615.642025:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211615.642033:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211615.642045:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660789248 00000100:00100000:3.0:1788211615.642053:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660789248 00000100:00100000:3.0:1788211615.642088:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660789376 00000100:00100000:3.0:1788211615.642091:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660789376 00000100:00100000:3.0:1788211615.642100:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660789504 00000100:00100000:3.0:1788211615.642102:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660789504 00000100:00100000:3.0:1788211615.642110:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660789632 00000100:00100000:3.0:1788211615.642112:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660789632 00000100:00100000:3.0:1788211615.642120:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660789760 00000100:00100000:3.0:1788211615.642122:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660789760 00000100:00100000:3.0:1788211615.642134:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788211615.642143:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd0408c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+7:5836:x1875075660789248:12345-0@lo:104: 00010000:00010000:3.0:1788211615.642157:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a53da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642254:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788211615.642268:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd0408c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+7:5836:x1875075660789248:12345-0@lo:104: Request processed in 127us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.642275:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788211615.642315:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788211615.642321:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+6:5836:x1875075660789376:12345-0@lo:104: 00010000:00010000:3.0:1788211615.642330:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a53b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642363:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788211615.642368:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+6:5836:x1875075660789376:12345-0@lo:104: Request processed in 48us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.642374:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788211615.642387:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788211615.642392:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+5:5836:x1875075660789504:12345-0@lo:104: 00010000:00010000:3.0:1788211615.642399:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5394 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642422:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788211615.642426:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+5:5836:x1875075660789504:12345-0@lo:104: Request processed in 35us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.642431:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788211615.642441:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788211615.642445:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+4:5836:x1875075660789632:12345-0@lo:104: 00010000:00010000:3.0:1788211615.642451:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a536a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642471:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788211615.642481:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+4:5836:x1875075660789632:12345-0@lo:104: Request processed in 35us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.642486:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788211615.642498:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788211615.642504:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+3:5836:x1875075660789760:12345-0@lo:104: 00010000:00010000:3.0:1788211615.642524:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5340 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642552:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788211615.642557:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+3:5836:x1875075660789760:12345-0@lo:104: Request processed in 53us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.642562:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788211615.642579:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788211615.642584:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a53da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642592:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030000 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211615.642596:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a53da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642670:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a53da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211615.642678:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a53da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211615.642684:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788211615.642715:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a53da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642735:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211615.642752:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a53da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642758:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc0030000/0x2afbce82f55a53d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a53da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642774:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788211615.642778:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a53b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642784:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4a00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211615.642787:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a53b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642795:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a53b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211615.642801:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a53b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211615.642806:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788211615.642818:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a53b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642823:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211615.642828:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a53b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642833:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4a00/0x2afbce82f55a53a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a53b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642848:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788211615.642851:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5394 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642856:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063600 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211615.642859:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a5394 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642866:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a5394 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211615.642872:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a5394 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211615.642877:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788211615.642888:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5394 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642894:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211615.642904:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5394 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642911:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a538d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5394 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642919:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788211615.642922:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a536a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642937:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c0000 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211615.642940:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a536a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642946:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a536a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211615.642953:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a536a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211615.642958:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788211615.642970:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a536a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642975:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211615.642980:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a536a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642986:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8ac0020c0000/0x2afbce82f55a5363 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a536a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.642996:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211615.642999:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5340 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.643004:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b400 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211615.643007:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a5340 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.643023:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a5340 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211615.643029:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a5340 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211615.643034:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788211615.643047:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5340 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.643052:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211615.643056:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5340 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.643062:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a5339 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5340 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.643076:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211615.643078:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211615.643080:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211615.643234:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211615.643282:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660789248:0@lo:104: 00000100:00100000:0.0:1788211615.643293:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660789376:0@lo:104: 00000100:00100000:0.0:1788211615.643302:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660789504:0@lo:104: 00000100:00100000:0.0:1788211615.643310:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660789632:0@lo:104: 00000100:00100000:0.0:1788211615.643317:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875075660789760:0@lo:104: 00010000:00010000:0.0:1788211615.643349:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211615.646967:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660789888:0@lo:103: 00000100:00100000:2.0:1788211615.647069:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211615.647132:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660790400:0@lo:103: 00000100:00100000:2.0:1788211615.647221:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211615.647260:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788211615.647278:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660790016:0@lo:103: 00000100:00100000:2.0:1788211615.647298:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211615.647335:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660790144:0@lo:103: 00000100:00100000:2.0:1788211615.647359:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211615.647373:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211615.647378:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660790272:0@lo:103: 00000100:00100000:2.0:1788211615.647394:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211615.647421:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660789888 00000100:00100000:2.0:1788211615.647433:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660789888 00010000:00010000:2.0:1788211615.647482:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfcb37b000/0x2afbce82f55a53da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a53d3 expref: 17 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211615.647630:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660790400 00000100:00100000:3.0:1788211615.647635:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660790400 00010000:00010000:3.0:1788211615.647654:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a5340 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5339 expref: 18 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211615.647667:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660790016 00000100:00100000:3.0:1788211615.647671:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660790016 00010000:00010000:3.0:1788211615.647681:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a53b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a53a9 expref: 19 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211615.647689:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660790144 00000100:00100000:3.0:1788211615.647699:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660790144 00010000:00010000:3.0:1788211615.647712:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a5394 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a538d expref: 20 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211615.647723:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660790272 00000100:00100000:3.0:1788211615.647725:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660790272 00010000:00010000:3.0:1788211615.647757:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a536a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5363 expref: 21 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211615.647776:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788211615.647786:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+21:3310:x1875075660789888:12345-0@lo:103: 00010000:00010000:3.0:1788211615.647804:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211615.647809:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfcb37b000/0x2afbce82f55a53da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a53d3 expref: 21 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.647822:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfcb37b000/0x2afbce82f55a53da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a53d3 expref: 21 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.647843:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37b000/0x2afbce82f55a53da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a53d3 expref: 21 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.647861:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211615.647911:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+20:3310:x1875075660789888:12345-0@lo:103: Request processed in 127us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.647919:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788211615.647941:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788211615.647947:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660790400:12345-0@lo:103: 00010000:00010000:3.0:1788211615.647954:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211615.647958:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a5340 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5339 expref: 19 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.647978:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a5340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5339 expref: 19 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.647989:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac0020c0800/0x2afbce82f55a5340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5339 expref: 19 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648001:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211615.648024:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+18:3310:x1875075660790400:12345-0@lo:103: Request processed in 78us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.648030:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788211615.648044:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788211615.648050:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+17:3310:x1875075660790016:12345-0@lo:103: 00010000:00010000:3.0:1788211615.648057:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211615.648061:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a53b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a53a9 expref: 17 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648069:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a53b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a53a9 expref: 17 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648078:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a53b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a53a9 expref: 17 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648086:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211615.648105:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+16:3310:x1875075660790016:12345-0@lo:103: Request processed in 55us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.648110:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788211615.648120:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788211615.648125:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+15:3308:x1875075660790144:12345-0@lo:103: 00010000:00010000:3.0:1788211615.648138:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211615.648144:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a5394 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a538d expref: 15 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648152:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a5394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a538d expref: 15 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648162:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a5394 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a538d expref: 15 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648200:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211615.648228:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+14:3308:x1875075660790144:12345-0@lo:103: Request processed in 103us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.648234:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788211615.648245:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788211615.648250:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+13:3308:x1875075660790272:12345-0@lo:103: 00010000:00010000:3.0:1788211615.648267:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211615.648271:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a536a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5363 expref: 13 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648280:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a536a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5363 expref: 13 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648290:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a536a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5363 expref: 13 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648302:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648310:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648333:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648341:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648347:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648354:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648360:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c5600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211615.648364:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648372:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648386:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.648395:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211615.648417:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+12:3308:x1875075660790272:12345-0@lo:103: Request processed in 167us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.648424:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788211615.648945:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660790272:0@lo:103: 00000100:00100000:2.0:1788211615.648958:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660790144:0@lo:103: 00000100:00100000:2.0:1788211615.648991:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660790016:0@lo:103: 00000100:00100000:2.0:1788211615.649000:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660789888:0@lo:103: 00000100:00100000:2.0:1788211615.649007:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660790400:0@lo:103: 00010000:00010000:0.0:1788211615.649364:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.649376:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.649384:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c5600/0x2afbce82f55a53ef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788211615.649418:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788211615.716350:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+11:7638:x1875075660789120:12345-0@lo:253: Request processed in 94182us (94862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211615.716369:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788211615.716531:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660789120:0@lo:253: 10000000:01000000:0.0:1788211615.716553:0:7638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788211615.716557:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788211615.716559:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788211615.716561:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788211615.716562:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788211615.716564:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788211615.716565:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788211615.716567:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788211615.716569:0:7638:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788211615.716571:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788211615.716573:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788211615.716610:0:7638:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8abfcaf32000 from lustre-OST0001 10000000:01000000:0.0:1788211615.716643:0:7638:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788211615.716646:0:7638:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788211615.716657:0:7638:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8abfca8a4d28 local copy 10000000:01000000:0.0:1788211615.716663:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788211615.716716:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.716731:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.716740:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211615.716763:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660790528:0@lo:101: 00000100:00100000:0.0:1788211615.716811:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211615.716879:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9cae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788211615.717076:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660790528 00000100:00100000:1.0:1788211615.717085:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660790528 00000100:00100000:1.0:1788211615.717135:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788211615.717144:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc923bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+11:7638:x1875075660790528:12345-0@lo:101: 00010000:00010000:1.0:1788211615.717158:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211615.717221:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a53fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a53f6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211615.717252:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a53fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a53f6 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211615.717286:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a53fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a53f6 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211615.717296:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37ac00, rc 0) 00000100:00100000:1.0:1788211615.717332:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc923bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:7638:x1875075660790528:12345-0@lo:101: Request processed in 188us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211615.717338:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788211615.717987:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660790528:0@lo:101: 00010000:00010000:0.0:1788211615.718011:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2afbce82f55a53fd expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.718021:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2afbce82f55a53fd expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211615.718137:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660790656:0@lo:501: 00000100:00100000:0.0:1788211615.718213:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211615.718237:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9cae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788211615.718296:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660790656 00000100:00100000:1.0:1788211615.718301:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660790656 00000100:00100000:1.0:1788211615.718341:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788211615.718349:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc923b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:7638:x1875075660790656:12345-0@lo:501: 00000100:00100000:1.0:1788211615.718593:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc923b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:7638:x1875075660790656:12345-0@lo:501: Request processed in 243us (379us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788211615.718610:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788211615.718894:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660790656:0@lo:501: 10000000:01000000:0.0:1788211615.718909:0:7638:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788211615.718937:0:7638:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788211615.718943:0:7638:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2afbce82f55a53fd expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.718952:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2afbce82f55a53fd expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.718959:0:7638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2afbce82f55a53fd expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.718981:0:7638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788211615.719001:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8abfcaf32000 10000000:01000000:0.0:1788211615.719006:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788211615.719012:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788211615.719014:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788211615.719019:0:7638:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788211615.719021:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788211615.719291:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.719301:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.719311:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211615.719326:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660790784:0@lo:101: 00000100:00100000:0.0:1788211615.719361:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211615.719383:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9ca6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788211615.719483:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211615.719492:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2afbce82f55a53fd expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.719522:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030200 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211615.719527:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2afbce82f55a53fd expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.719535:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2afbce82f55a53fd expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211615.719543:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2afbce82f55a53fd expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211615.719548:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788211615.719569:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2afbce82f55a53fd expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.719575:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788211615.719743:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660790912:0@lo:103: 00000100:00100000:2.0:1788211615.719779:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211615.719825:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660790912 00000100:00100000:2.0:1788211615.719832:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660790912 00000100:00100000:2.0:1788211615.719870:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211615.719878:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+12:3311:x1875075660790912:12345-0@lo:103: 00010000:00010000:2.0:1788211615.719897:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211615.719911:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a53fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a53f6 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211615.719927:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211615.719957:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+11:3311:x1875075660790912:12345-0@lo:103: Request processed in 79us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211615.719964:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211615.719998:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660790912:0@lo:103: 00010000:00010000:3.0:1788211615.720037:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2afbce82f55a53fd expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.720046:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc0030200/0x2afbce82f55a53f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2afbce82f55a53fd expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.720057:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211615.720059:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211615.720061:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211615.720341:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660790784 00000100:00100000:1.0:1788211615.720345:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660790784 00000100:00100000:1.0:1788211615.720381:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788211615.720389:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+11:7638:x1875075660790784:12345-0@lo:101: 00010000:00010000:1.0:1788211615.720402:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211615.720415:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a540b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5404 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211615.720434:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a540b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5404 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211615.720444:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a540b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5404 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211615.720463:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b200, rc 0) 00000100:00100000:3.0:1788211615.720640:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660790784:0@lo:101: 00010000:00010000:3.0:1788211615.720653:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a540b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.720660:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a540b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211615.720759:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791040:0@lo:501: 00000100:00100000:3.0:1788211615.720788:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211615.720821:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788211615.720919:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660791040 00000100:00100000:2.0:1788211615.720923:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660791040 00000100:00100000:2.0:1788211615.720956:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788211615.720963:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660791040:12345-0@lo:501: 00000100:00100000:2.0:1788211615.721221:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660791040:12345-0@lo:501: Request processed in 257us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211615.721229:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788211615.721296:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:7638:x1875075660790784:12345-0@lo:101: Request processed in 907us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211615.721302:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788211615.721743:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791040:0@lo:501: 00000100:00100000:3.0:1788211615.721787:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791168:0@lo:503: 00000100:00100000:3.0:1788211615.721842:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211615.721916:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788211615.727337:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660791168 00000100:00100000:2.0:1788211615.727353:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660791168 00000100:00100000:0.0:1788211615.728261:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788211615.728274:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:7638:x1875075660791168:12345-0@lo:503: 00000100:00100000:0.0:1788211615.728538:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:7638:x1875075660791168:12345-0@lo:503: Request processed in 266us (6695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211615.728546:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788211615.728869:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791168:0@lo:503: 00000040:00080000:2.0:1788211615.729203:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788211615.729279:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791296:0@lo:502: 00000100:00100000:2.0:1788211615.729336:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211615.729383:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc6300 going to sleep for 11 seconds 00000100:00100000:0.0:1788211615.730140:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660791296 00000100:00100000:0.0:1788211615.730149:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660791296 00000100:00100000:0.0:1788211615.730238:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788211615.730248:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:7638:x1875075660791296:12345-0@lo:502: 00000100:00100000:0.0:1788211615.730470:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:7638:x1875075660791296:12345-0@lo:502: Request processed in 223us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211615.730479:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788211615.732806:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791296:0@lo:502: 00000040:00080000:0.0:1788211615.741737:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788211615.741894:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788211615.741943:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788211615.742032:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788211615.742073:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788211615.742118:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788211615.742211:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791424:0@lo:502: 00000100:00100000:0.0:1788211615.742310:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211615.742364:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9ca540 going to sleep for 11 seconds 00000100:00100000:1.0:1788211615.742993:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660791424 00000100:00100000:1.0:1788211615.743006:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660791424 00000100:00100000:1.0:1788211615.743092:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788211615.743104:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:7638:x1875075660791424:12345-0@lo:502: 00000100:00100000:1.0:1788211615.743412:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+12:7638:x1875075660791424:12345-0@lo:502: Request processed in 309us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211615.743420:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788211615.743858:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791424:0@lo:502: 00000040:00080000:3.0:1788211615.744063:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788211615.744081:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788211615.749910:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788211615.749924:0:7646:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788211615.749931:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211615.749934:0:7646:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788211615.749940:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788211615.749958:0:7646:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8abfca8bb370) 00000020:00000080:1.0:1788211615.749984:0:7646:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788211615.749990:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788211615.750052:0:7646:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abfcaf32000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788211615.750061:0:7646:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788211615.750068:0:7646:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2afbce82f55a5419 00010000:00010000:1.0:1788211615.759386:0:7646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788211615.760021:0:7646:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788211615.767959:0:7646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788211615.770458:0:7646:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788211615.780966:0:7646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788211615.782057:0:7646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788211615.784817:0:7646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788211615.784834:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211615.784841:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211615.784843:0:7646:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788211615.784847:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788211615.784851:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211615.784853:0:7646:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788211615.784856:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788211615.784858:0:7646:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788211615.784927:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211615.784930:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211615.784931:0:7646:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788211615.784941:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788211615.787010:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788211615.787049:0:7638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788211615.787076:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a540b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.787090:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a540b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211615.787100:0:7638:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfcaf32000 from 1 10000000:01000000:3.0:1788211615.787103:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788211615.787141:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.787151:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.787162:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211615.787236:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791552:0@lo:101: 00000100:00100000:3.0:1788211615.787308:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211615.787350:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660791552 00000100:00100000:3.0:1788211615.787358:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660791552 00000100:00100000:3.0:1788211615.787403:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788211615.787412:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:7638:x1875075660791552:12345-0@lo:101: 00010000:00010000:3.0:1788211615.787425:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211615.787437:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6062600/0x2afbce82f55a5427 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5420 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.787460:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6062600/0x2afbce82f55a5427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5420 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.787470:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6062600/0x2afbce82f55a5427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5420 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.787479:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062600, rc 0) 00000100:00100000:3.0:1788211615.787512:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660791552:12345-0@lo:101: Request processed in 100us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.787519:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788211615.787567:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788211615.787587:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791552:0@lo:101: 00010000:00010000:3.0:1788211615.787600:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5427 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.787609:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5427 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211615.788156:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791680:0@lo:501: 00000100:00100000:3.0:1788211615.788224:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211615.788249:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788211615.790802:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660791680 00000100:00100000:0.0:1788211615.790816:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660791680 00000100:00100000:0.0:1788211615.790891:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788211615.790904:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660791680:12345-0@lo:501: 00000100:00100000:0.0:1788211615.791321:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660791680:12345-0@lo:501: Request processed in 417us (3094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211615.791331:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788211615.792852:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791680:0@lo:501: 00000100:00100000:3.0:1788211615.792919:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791808:0@lo:503: 00000100:00100000:3.0:1788211615.792996:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211615.793051:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788211615.793586:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660791808 00000100:00100000:0.0:1788211615.793593:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660791808 00000100:00100000:0.0:1788211615.793901:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788211615.793914:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660791808:12345-0@lo:503: 00000100:00100000:0.0:1788211615.794411:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660791808:12345-0@lo:503: Request processed in 499us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211615.794420:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788211615.794536:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791808:0@lo:503: 00000040:00080000:3.0:1788211615.794896:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788211615.795004:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791936:0@lo:502: 00000100:00100000:3.0:1788211615.795059:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211615.801056:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788211615.802074:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660791936 00000100:00100000:2.0:1788211615.802096:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660791936 00000100:00100000:2.0:1788211615.803353:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788211615.803375:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660791936:12345-0@lo:502: 00000100:00100000:2.0:1788211615.804006:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660791936:12345-0@lo:502: Request processed in 636us (8944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211615.804017:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788211615.807897:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660791936:0@lo:502: 00000040:00080000:3.0:1788211615.809023:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788211615.809108:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788211615.810390:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660792064:0@lo:502: 00000100:00100000:3.0:1788211615.810788:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211615.810911:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788211615.813403:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660792064 00000100:00100000:2.0:1788211615.813423:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660792064 00000100:00100000:2.0:1788211615.813553:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788211615.813564:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660792064:12345-0@lo:502: 00000100:00100000:2.0:1788211615.814076:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660792064:12345-0@lo:502: Request processed in 512us (3566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211615.814085:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788211615.814245:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660792064:0@lo:502: 00000040:00080000:3.0:1788211615.814460:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788211615.814478:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788211615.819891:0:7650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788211615.819911:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211615.819913:0:7650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788211615.819941:0:7650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abfcaf32000 00000020:00000080:3.0:1788211615.819944:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788211615.819967:0:7650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211615.819970:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211615.819972:0:7650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788211615.819975:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788211615.820408:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788211615.820444:0:7638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788211615.820470:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5427 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.820485:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5427 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211615.820560:0:7638:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788211615.820564:0:7638:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8abfcaf32000 10000000:01000000:0.0:1788211615.820568:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8abfcaf32000 10000000:01000000:0.0:1788211615.820583:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788211615.820591:0:7638:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8abfcaf32000 from 1 10000000:01000000:0.0:1788211615.820594:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788211615.820858:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.820867:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.820881:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211615.820913:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660792192:0@lo:101: 00000100:00100000:0.0:1788211615.821021:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211615.824829:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9cc180 going to sleep for 11 seconds 00000100:00100000:1.0:1788211615.824969:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660792192 00000100:00100000:1.0:1788211615.824983:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660792192 00000100:00100000:3.0:1788211615.825066:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788211615.825083:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660792192:12345-0@lo:101: 00010000:00010000:3.0:1788211615.825106:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211615.825147:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5435 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a542e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.825215:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a542e expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.825227:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a542e expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211615.825237:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062a00, rc 0) 00000100:00100000:3.0:1788211615.825312:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+14:7638:x1875075660792192:12345-0@lo:101: Request processed in 235us (4293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.825319:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788211615.825854:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660792192:0@lo:101: 00010000:00010000:0.0:1788211615.825877:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5435 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.825889:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5435 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211615.826056:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660792320:0@lo:501: 00000100:00100000:0.0:1788211615.826107:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211615.826368:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9cc180 going to sleep for 11 seconds 00000100:00100000:3.0:1788211615.826682:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660792320 00000100:00100000:3.0:1788211615.827034:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660792320 00000100:00100000:3.0:1788211615.827110:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788211615.827119:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+14:7638:x1875075660792320:12345-0@lo:501: 00000100:00100000:3.0:1788211615.827850:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+14:7638:x1875075660792320:12345-0@lo:501: Request processed in 729us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.827862:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788211615.828015:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660792320:0@lo:501: 00000100:00100000:0.0:1788211615.828079:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660792448:0@lo:503: 00000100:00100000:0.0:1788211615.829280:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211615.829388:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9cc180 going to sleep for 11 seconds 00000100:00100000:1.0:1788211615.829543:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660792448 00000100:00100000:1.0:1788211615.829555:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660792448 00000100:00100000:3.0:1788211615.829859:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788211615.829875:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+14:7638:x1875075660792448:12345-0@lo:503: 00000100:00100000:3.0:1788211615.830193:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+14:7638:x1875075660792448:12345-0@lo:503: Request processed in 294us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.830202:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788211615.830456:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660792448:0@lo:503: 00000040:00080000:0.0:1788211615.831120:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788211615.831257:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660792576:0@lo:502: 00000100:00100000:0.0:1788211615.831329:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211615.831371:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9cc180 going to sleep for 11 seconds 00000100:00100000:3.0:1788211615.831856:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660792576 00000100:00100000:3.0:1788211615.831869:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660792576 00000100:00100000:3.0:1788211615.831921:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788211615.831933:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+14:7638:x1875075660792576:12345-0@lo:502: 00000100:00100000:3.0:1788211615.832481:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+14:7638:x1875075660792576:12345-0@lo:502: Request processed in 548us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.832492:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788211615.832862:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660792576:0@lo:502: 00000040:00080000:0.0:1788211615.833394:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788211615.833465:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788211615.833501:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788211615.833911:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788211615.833953:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788211615.834002:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788211615.834041:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788211615.834101:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788211615.834333:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788211615.834377:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788211615.834410:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788211615.834474:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788211615.834528:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788211615.834565:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788211615.834813:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788211615.834856:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788211615.834892:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788211615.834942:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788211615.834979:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788211615.835011:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788211615.835069:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788211615.835107:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788211615.835160:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788211615.835261:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788211615.835311:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788211615.835344:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788211615.835390:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788211615.835424:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788211615.835456:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788211615.835785:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788211615.835838:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788211615.835876:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788211615.835909:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788211615.835961:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788211615.835999:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788211615.836052:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788211615.836088:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788211615.836466:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660792704:0@lo:502: 00000100:00100000:0.0:1788211615.836800:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211615.836906:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9cc180 going to sleep for 11 seconds 00000100:00100000:1.0:1788211615.837424:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660792704 00000100:00100000:1.0:1788211615.837437:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660792704 00000100:00100000:1.0:1788211615.837489:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788211615.837500:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+14:7638:x1875075660792704:12345-0@lo:502: 00000100:00100000:1.0:1788211615.838631:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+14:7638:x1875075660792704:12345-0@lo:502: Request processed in 1128us (1826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211615.838647:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788211615.839010:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660792704:0@lo:502: 00000040:00080000:0.0:1788211615.839326:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788211615.839353:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788211615.841380:0:7651:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788211615.841399:0:7651:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8abfca8a19b8) 00000020:00000080:2.0:1788211615.841425:0:7651:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788211615.841560:0:7651:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abfcaf32000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788211615.841566:0:7651:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8abfcaf32000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788211615.841569:0:7651:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abfcaf32000 3 00010000:00080000:2.0:1788211615.841605:0:7651:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abec6692000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.129@tcp at head 00010000:00010000:3.0:1788211615.843329:0:7651:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788211615.844442:0:7651:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788211615.844494:0:7651:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788211615.844769:0:7651:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2afbce82f55a5443 00000100:00080000:3.0:1788211615.844784:0:7651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788211615.844791:0:7651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8abec6692000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1788211615.844836:0:7651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abff6462a00 x1875075660792832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788211615.844897:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875075660792832:0@lo:38: 00000100:00100000:1.0:1788211615.844976:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788211615.846438:0:7651:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788211615.848093:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660792832 00000100:00100000:2.0:1788211615.848110:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660792832 00000100:00100000:2.0:1788211615.848193:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788211615.848205:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875075660792832:12345-0@lo:38: 00010000:00080000:2.0:1788211615.848242:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1788211615.848493:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2afbce82f55a544a 00000004:00100000:2.0:1788211615.848516:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788211615.848568:0:5845:0:(import.c:65:import_set_state_nolock()) ffff8abec6693000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788211615.851569:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660793216:0@lo:400: 00000100:00100000:3.0:1788211615.851674:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211615.851747:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660793216 00000100:00100000:3.0:1788211615.851754:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660793216 00000100:00100000:3.0:1788211615.851818:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788211615.851831:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660793216:12345-0@lo:400: 00000100:00100000:3.0:1788211615.851910:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660793216:12345-0@lo:400: Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211615.851919:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788211615.851966:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abff6463800 x1875075660793216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211615.851981:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660793216:0@lo:400: 00000100:00080000:0.0:1788211615.855456:0:7653:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8abffdb93b80 x1875075660793344/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000040:00080000:3.0:1788211615.855466:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1788211615.855472:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec6752c00 going to sleep for 0 seconds 00000020:01000000:0.0:1788211615.855601:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788211615.855634:0:7638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788211615.855663:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5435 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.855674:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5435 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788211615.855745:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788211615.855747:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788211615.855749:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788211615.855750:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788211615.855751:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788211615.855753:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788211615.855755:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788211615.855757:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788211615.855758:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788211615.855760:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788211615.855761:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788211615.855767:0:7638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788211615.855770:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788211615.855772:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788211615.855773:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788211615.855774:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788211615.855775:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788211615.855776:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788211615.855777:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788211615.855778:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788211615.855779:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788211615.855780:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788211615.855781:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788211615.855796:0:7638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788211615.855808:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660793472:0@lo:253: 00000100:00100000:0.0:1788211615.855902:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211615.855955:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec6752780 going to sleep for 11 seconds 00000100:00100000:2.0:1788211615.856438:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875075660792832:12345-0@lo:38: Request processed in 8229us (11456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211615.857262:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788211615.857326:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660793472 00000100:00100000:2.0:1788211615.857335:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660793472 00000100:00100000:2.0:1788211615.857386:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788211615.857395:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:7638:x1875075660793472:12345-0@lo:253: 20000000:01000000:2.0:1788211615.857427:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788211615.858276:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788211615.858955:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660792960:0@lo:400: 00000100:00100000:2.0:1788211615.859042:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211615.859091:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211615.859099:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660793088:0@lo:400: 00000100:00100000:2.0:1788211615.859120:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788211615.859156:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788211615.859267:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660792960 00000100:00100000:2.0:1788211615.859277:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660792960 00000100:00100000:2.0:1788211615.859320:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660793088 00000100:00100000:2.0:1788211615.859323:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660793088 00000100:00100000:2.0:1788211615.859352:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788211615.859362:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660792960:12345-0@lo:400: 00000100:00100000:2.0:1788211615.859432:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660792960:12345-0@lo:400: Request processed in 72us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211615.859442:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788211615.861850:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abff6462a00 x1875075660792832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788211625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211615.861872:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788211615.861885:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788211615.861908:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788211615.861916:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788211615.861923:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec6692000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788211615.861934:0:3307:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000034aa8b54): req@ffff8abffdb93b80 x1875075660793344/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211615.861964:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875075660792832:0@lo:38: 00000100:00100000:2.0:1788211615.862121:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788211615.862137:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660793088:12345-0@lo:400: 00000100:00100000:2.0:1788211615.862260:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660793088:12345-0@lo:400: Request processed in 129us (3137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211615.862268:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788211615.862309:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788211615.862343:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abff6461180 x1875075660793088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211615.862354:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660793088:0@lo:400: 00010000:00080000:2.0:1788211615.862370:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abff6463100 x1875075660792960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211615.862378:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660792960:0@lo:400: 00000100:00100000:1.0:1788211615.862435:0:7653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211615.862475:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec6752c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788211615.862578:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660793344 00000100:00100000:2.0:1788211615.862586:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660793344 00000100:00100000:2.0:1788211615.862644:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788211615.862651:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7653:x1875075660793344:12345-0@lo:901: 00000100:00100000:2.0:1788211615.863958:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7653:x1875075660793344:12345-0@lo:901: Request processed in 1296us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211615.863972:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788211615.864015:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788211615.864244:0:7653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abffdb93b80 x1875075660793344/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788211631 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211615.864261:0:7653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7653:1875075660793344:0@lo:901: 00010000:00010000:0.0:1788211615.909640:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788211615.935895:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788211615.935916:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788211615.937456:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788211615.937466:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788211615.937495:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211615.937516:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a53a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a539b expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211615.937525:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211615.937570:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a53a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a539b expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211615.937586:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a53a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a539b expref: 14 pid: 5835 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211615.937608:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1875075660793600:0@lo:104: 00000100:00100000:1.0:1788211615.937693:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211615.937768:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe477c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211615.938491:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660793600 00000100:00100000:0.0:1788211615.938500:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660793600 00000100:00100000:0.0:1788211615.938556:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788211615.938566:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+3:5859:x1875075660793600:12345-0@lo:104: 00010000:00010000:0.0:1788211615.938590:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a53a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.938668:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788211615.938674:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afe7852e-b478-4e21-8864-7e739fb0a137+3:5859:x1875075660793600:12345-0@lo:104: Request processed in 111us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211615.938682:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788211615.938709:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211615.938715:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a53a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.938722:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211615.938727:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a53a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.938735:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a53a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211615.938742:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a53a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211615.938748:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788211615.938780:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a53a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.938786:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211615.938805:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a53a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.938810:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a539b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a53a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.938835:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211615.938837:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211615.938838:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211615.938859:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660793728:0@lo:103: 00000100:00100000:0.0:1788211615.938897:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211615.938943:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660793728 00000100:00100000:0.0:1788211615.938947:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660793728 00010000:00010000:0.0:1788211615.938964:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a53a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a539b expref: 15 pid: 5835 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211615.938985:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788211615.938991:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+15:3311:x1875075660793728:12345-0@lo:103: 00010000:00010000:0.0:1788211615.938999:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211615.939003:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a53a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a539b expref: 15 pid: 5835 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.939013:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a53a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a539b expref: 15 pid: 5835 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.939030:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.939037:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788211615.939051:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006573974s 00010000:00010000:0.0:1788211615.939054:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.939071:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.939078:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.939084:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.939090:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211615.939093:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.939099:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.939107:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.939115:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211615.939144:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+15:3311:x1875075660793728:12345-0@lo:103: Request processed in 154us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211615.939151:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788211615.939261:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660793728:0@lo:103: 00010000:00010000:0.0:1788211615.942696:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a53a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a539b expref: 14 pid: 5835 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211615.942725:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1875075660793600:0@lo:104: 00010000:00010000:0.0:1788211615.942752:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.942781:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.942787:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211615.942793:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5451 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211615.949607:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:7638:x1875075660793472:12345-0@lo:253: Request processed in 92194us (93686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211615.949625:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788211615.949809:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afe7852e-b478-4e21-8864-7e739fb0a137:7638:1875075660793472:0@lo:253: 10000000:01000000:3.0:1788211615.949831:0:7638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788211615.949836:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788211615.949838:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788211615.949839:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211615.949841:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211615.949842:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211615.949843:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211615.949845:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788211615.949847:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788211615.949849:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788211615.949851:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211615.949853:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788211615.949873:0:7638:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788211615.959582:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788211615.963710:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788211615.964036:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788211615.964536:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788211615.964787:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788211615.965044:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788211615.967648:0:7638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788211616.298252:0:7638:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788211616.298260:0:7638:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788211616.298308:0:7638:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788211616.298380:0:7638:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788211616.298402:0:7638:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788211616.298433:0:7638:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788211616.933364:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211617.509427:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788211617.509471:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660793856:0@lo:13: 00000100:00100000:1.0:1788211617.509580:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211617.509785:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660793856 00000100:00100000:2.0:1788211617.509808:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660793856 00000100:00100000:2.0:1788211617.509889:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788211617.509903:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660793856:12345-0@lo:13: 00002000:00000024:2.0:1788211617.509954:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211617.510013:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660793856:12345-0@lo:13: Request processed in 114us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211617.510201:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788211617.510300:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788211617.510342:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfefac4700 x1875075660793856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211617.510370:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660793856:0@lo:13: 00010000:00010000:0.0:1788211617.958407:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211618.984483:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211620.005891:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211621.033219:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211621.095461:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660793984:0@lo:400: 00000100:00100000:1.0:1788211621.095541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211621.095656:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660794496:0@lo:400: 00000100:00100000:1.0:1788211621.095698:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211621.095728:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788211621.095733:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660794368:0@lo:400: 00000100:00100000:1.0:1788211621.095760:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211621.095795:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660794112:0@lo:400: 00000100:00100000:1.0:1788211621.095817:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211621.095835:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788211621.095839:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660794240:0@lo:400: 00000100:00100000:1.0:1788211621.095855:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211621.095884:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660794368 00000100:00100000:1.0:1788211621.095891:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660794368 00000100:00100000:1.0:1788211621.095947:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788211621.095958:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660794368:12345-0@lo:400: 00000100:00100000:1.0:1788211621.096026:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660794368:12345-0@lo:400: Request processed in 70us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211621.096034:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788211621.096059:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660794496 00000100:00100000:1.0:1788211621.096063:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660794496 00000100:00100000:3.0:1788211621.096343:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660793984 00000100:00100000:3.0:1788211621.096347:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660793984 00000100:00100000:3.0:1788211621.096380:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788211621.096388:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:3309:x1875075660793984:12345-0@lo:400: 00000100:00100000:3.0:1788211621.096424:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:3309:x1875075660793984:12345-0@lo:400: Request processed in 37us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211621.096430:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788211621.102846:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660794112 00000100:00100000:2.0:1788211621.102865:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660794112 00000100:00100000:1.0:1788211621.106924:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660794240 00000100:00100000:1.0:1788211621.106944:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660794240 00000100:00100000:3.0:1788211621.109606:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788211621.109629:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875075660794496:12345-0@lo:400: 00000100:00100000:3.0:1788211621.109726:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875075660794496:12345-0@lo:400: Request processed in 110us (14027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211621.109734:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788211621.109761:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788211621.109767:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660794112:12345-0@lo:400: 00000100:00100000:3.0:1788211621.109801:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660794112:12345-0@lo:400: Request processed in 35us (13983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211621.109807:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788211621.109861:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca8b7b80 x1875075660794112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211621.109876:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660794112:0@lo:400: 00000100:00100000:1.0:1788211621.111427:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788211621.111452:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660794240:12345-0@lo:400: 00000100:00100000:1.0:1788211621.111552:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660794240:12345-0@lo:400: Request processed in 116us (15695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211621.111560:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788211621.111604:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788211621.111612:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788211621.111668:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca8b6680 x1875075660794368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211621.111711:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660794368:0@lo:400: 00000100:00100000:1.0:1788211621.111735:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660793984:0@lo:400: 00010000:00080000:1.0:1788211621.111756:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca8b5880 x1875075660794496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211621.111770:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660794496:0@lo:400: 00010000:00080000:2.0:1788211621.114649:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca8b5c00 x1875075660794240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211621.114705:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660794240:0@lo:400: 00010000:00010000:3.0:1788211622.058565:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211622.630441:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788211622.630474:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660794624:0@lo:13: 00000100:00100000:0.0:1788211622.630557:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211622.630678:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660794624 00000100:00100000:1.0:1788211622.630689:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660794624 00000100:00100000:1.0:1788211622.630753:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788211622.630764:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660794624:12345-0@lo:13: 00002000:00000024:1.0:1788211622.630813:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211622.630894:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660794624:12345-0@lo:13: Request processed in 131us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211622.630902:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788211622.631042:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca8b5880 x1875075660794624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211622.631072:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660794624:0@lo:13: 00010000:00010000:3.0:1788211623.077281:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788211623.154081:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788211623.154090:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ac001fd6800 from 30 10000000:01000000:2.0:1788211623.154097:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788211623.154144:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.154157:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.154195:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211623.154226:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660794752:0@lo:101: 00000100:00100000:2.0:1788211623.154303:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211623.154361:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788211623.157988:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660794752 00000100:00100000:1.0:1788211623.158004:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660794752 00000100:00100000:1.0:1788211623.158097:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788211623.158110:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660794752:12345-0@lo:101: 00010000:00010000:1.0:1788211623.158129:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211623.158152:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37a000/0x2afbce82f55a545f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5458 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.158209:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37a000/0x2afbce82f55a545f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5458 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.158222:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37a000/0x2afbce82f55a545f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5458 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.158234:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37a000, rc 0) 00000100:00100000:1.0:1788211623.158328:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660794752:12345-0@lo:101: Request processed in 219us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.158335:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788211623.158453:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660794752:0@lo:101: 00010000:00010000:2.0:1788211623.158475:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a545f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.158485:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a545f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211623.158593:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660794880:0@lo:501: 00000100:00100000:2.0:1788211623.158630:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211623.158674:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788211623.158799:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660794880 00000100:00100000:1.0:1788211623.158804:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660794880 00000100:00100000:1.0:1788211623.158839:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788211623.158848:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660794880:12345-0@lo:501: 00000100:00100000:1.0:1788211623.159321:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660794880:12345-0@lo:501: Request processed in 473us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.159331:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788211623.159514:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660794880:0@lo:501: 00000100:00100000:2.0:1788211623.159550:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660795008:0@lo:503: 00000100:00100000:2.0:1788211623.159592:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211623.159614:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788211623.159675:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660795008 00000100:00100000:0.0:1788211623.159680:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660795008 00000100:00100000:0.0:1788211623.159730:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788211623.159738:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660795008:12345-0@lo:503: 00000100:00100000:0.0:1788211623.160030:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660795008:12345-0@lo:503: Request processed in 292us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211623.160047:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788211623.160084:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660795008:0@lo:503: 00000100:00100000:0.0:1788211623.160306:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7935:1875075660795136:0@lo:502: 00000100:00100000:0.0:1788211623.160341:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211623.160362:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660795136 00000100:00100000:0.0:1788211623.160365:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660795136 00000100:00100000:0.0:1788211623.160388:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788211623.160395:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:7935:x1875075660795136:12345-0@lo:502: 00000100:00100000:0.0:1788211623.160601:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:7935:x1875075660795136:12345-0@lo:502: Request processed in 206us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211623.160608:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788211623.160643:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec67523c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211623.160655:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7935:1875075660795136:0@lo:502: 00000100:00100000:0.0:1788211623.160696:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7935:1875075660795264:0@lo:502: 00000100:00100000:0.0:1788211623.160727:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211623.160745:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660795264 00000100:00100000:0.0:1788211623.160749:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660795264 00000100:00100000:0.0:1788211623.160769:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788211623.160775:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:7935:x1875075660795264:12345-0@lo:502: 00000100:00100000:0.0:1788211623.160888:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:7935:x1875075660795264:12345-0@lo:502: Request processed in 112us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211623.160903:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788211623.160930:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec67523c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211623.160941:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7935:1875075660795264:0@lo:502: 00000040:00080000:0.0:1788211623.160961:0:7935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788211623.161018:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788211623.161048:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788211623.161059:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a545f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211623.161070:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a545f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211623.161080:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788211623.161083:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788211623.161086:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788211623.161109:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211623.161117:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211623.161127:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211623.161139:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660795392:0@lo:101: 00000100:00100000:0.0:1788211623.161187:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211623.161204:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec67523c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211623.161216:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660795392 00000100:00100000:0.0:1788211623.161219:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660795392 00000100:00100000:0.0:1788211623.161246:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788211623.161252:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660795392:12345-0@lo:101: 00010000:00010000:0.0:1788211623.161259:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211623.161273:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a546d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5466 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211623.161293:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a546d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5466 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211623.161302:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a546d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5466 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211623.161310:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030600, rc 0) 00000100:00100000:0.0:1788211623.161337:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660795392:12345-0@lo:101: Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211623.161342:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788211623.161368:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660795392:0@lo:101: 00010000:00010000:0.0:1788211623.161380:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a546d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211623.161389:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a546d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211623.161425:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660795520:0@lo:501: 00000100:00100000:0.0:1788211623.161447:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211623.161459:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec67523c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211623.161471:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660795520 00000100:00100000:0.0:1788211623.161474:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660795520 00000100:00100000:0.0:1788211623.161493:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788211623.161505:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660795520:12345-0@lo:501: 00000100:00100000:0.0:1788211623.161727:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660795520:12345-0@lo:501: Request processed in 222us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211623.161734:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788211623.161761:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660795520:0@lo:501: 00000100:00100000:0.0:1788211623.161784:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660795648:0@lo:503: 00000100:00100000:0.0:1788211623.161815:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211623.161827:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec67523c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211623.161837:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660795648 00000100:00100000:0.0:1788211623.161841:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660795648 00000100:00100000:0.0:1788211623.161859:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788211623.161865:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660795648:12345-0@lo:503: 00000100:00100000:0.0:1788211623.162124:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660795648:12345-0@lo:503: Request processed in 258us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211623.162130:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788211623.162188:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660795648:0@lo:503: 00000100:00100000:0.0:1788211623.162445:0:7936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7936:1875075660795776:0@lo:502: 00000100:00100000:0.0:1788211623.165513:0:7936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211623.165602:0:7936:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec6752900 going to sleep for 11 seconds 00000100:00100000:2.0:1788211623.165680:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660795776 00000100:00100000:2.0:1788211623.165697:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660795776 00000100:00100000:2.0:1788211623.165774:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788211623.165787:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:7936:x1875075660795776:12345-0@lo:502: 00000100:00100000:2.0:1788211623.166205:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:7936:x1875075660795776:12345-0@lo:502: Request processed in 419us (3723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211623.166214:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788211623.169352:0:7936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7936:1875075660795776:0@lo:502: 00000020:01000000:0.0:1788211623.169417:0:7936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211623.169432:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211623.169434:0:7936:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788211623.169440:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788211623.169442:0:7936:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788211623.169487:0:7936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7936:1875075660795904:0@lo:502: 00000100:00100000:0.0:1788211623.169594:0:7936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211623.169642:0:7936:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec6752900 going to sleep for 11 seconds 00000100:00100000:1.0:1788211623.169712:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660795904 00000100:00100000:1.0:1788211623.169728:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660795904 00000100:00100000:1.0:1788211623.169796:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788211623.169819:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:7936:x1875075660795904:12345-0@lo:502: 00000100:00100000:1.0:1788211623.170089:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:7936:x1875075660795904:12345-0@lo:502: Request processed in 272us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.170097:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788211623.170428:0:7936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7936:1875075660795904:0@lo:502: 00000020:01000000:0.0:1788211623.170454:0:7936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211623.170460:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211623.170462:0:7936:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788211623.170466:0:7936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788211623.175971:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788211623.176019:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788211623.176048:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a546d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.176063:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a546d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211623.176078:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788211623.176081:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8abfc288e800 from 30 10000000:01000000:1.0:1788211623.176084:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788211623.176136:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.176145:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.176157:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211623.176197:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660796032:0@lo:101: 00000100:00100000:1.0:1788211623.176278:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211623.176312:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec10b80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211623.176340:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660796032 00000100:00100000:1.0:1788211623.176356:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660796032 00000100:00100000:1.0:1788211623.176406:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788211623.176415:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660796032:12345-0@lo:101: 00010000:00010000:1.0:1788211623.176428:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211623.176441:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37b400/0x2afbce82f55a547b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5474 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.176465:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37b400/0x2afbce82f55a547b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5474 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.176476:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37b400/0x2afbce82f55a547b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5474 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.176486:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b400, rc 0) 00000100:00100000:1.0:1788211623.176526:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660796032:12345-0@lo:101: Request processed in 112us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.176534:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788211623.176584:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660796032:0@lo:101: 00010000:00010000:1.0:1788211623.176596:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a547b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.176605:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a547b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211623.176654:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660796160:0@lo:501: 00000100:00100000:1.0:1788211623.176677:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211623.176693:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec10b80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211623.176707:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660796160 00000100:00100000:1.0:1788211623.176711:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660796160 00000100:00100000:1.0:1788211623.176739:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788211623.176745:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660796160:12345-0@lo:501: 00000100:00100000:1.0:1788211623.177045:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660796160:12345-0@lo:501: Request processed in 289us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.177052:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788211623.177082:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660796160:0@lo:501: 00000100:00100000:1.0:1788211623.177108:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660796288:0@lo:503: 00000100:00100000:1.0:1788211623.177142:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211623.177156:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec10b80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211623.177194:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660796288 00000100:00100000:1.0:1788211623.177199:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660796288 00000100:00100000:1.0:1788211623.177222:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788211623.177229:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660796288:12345-0@lo:503: 00000100:00100000:1.0:1788211623.177394:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660796288:12345-0@lo:503: Request processed in 164us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.177400:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788211623.177440:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660796288:0@lo:503: 00000100:00100000:1.0:1788211623.177655:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7937:1875075660796416:0@lo:502: 00000100:00100000:1.0:1788211623.177692:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211623.177709:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660796416 00000100:00100000:1.0:1788211623.177713:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660796416 00000100:00100000:1.0:1788211623.177734:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788211623.177741:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+16:7937:x1875075660796416:12345-0@lo:502: 00000100:00100000:1.0:1788211623.177894:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+16:7937:x1875075660796416:12345-0@lo:502: Request processed in 153us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.177926:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788211623.177955:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec10b8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788211623.177967:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7937:1875075660796416:0@lo:502: 00000100:00100000:1.0:1788211623.178004:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7937:1875075660796544:0@lo:502: 00000100:00100000:1.0:1788211623.178033:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211623.178062:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660796544 00000100:00100000:1.0:1788211623.178065:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660796544 00000100:00100000:1.0:1788211623.178085:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788211623.178090:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+16:7937:x1875075660796544:12345-0@lo:502: 00000100:00100000:1.0:1788211623.178213:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+16:7937:x1875075660796544:12345-0@lo:502: Request processed in 122us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.178219:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788211623.178243:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4ad9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788211623.178253:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7937:1875075660796544:0@lo:502: 00000040:00080000:1.0:1788211623.178271:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788211623.178331:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788211623.178347:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788211623.178356:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a547b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.178365:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a547b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211623.178374:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788211623.178377:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8abfc288e800 from 5 10000000:01000000:1.0:1788211623.178379:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788211623.178400:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.178414:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.178423:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211623.178434:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660796672:0@lo:101: 00000100:00100000:1.0:1788211623.178457:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211623.178469:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4ad9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788211623.178480:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660796672 00000100:00100000:1.0:1788211623.178483:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660796672 00000100:00100000:1.0:1788211623.178503:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788211623.178508:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660796672:12345-0@lo:101: 00010000:00010000:1.0:1788211623.178516:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211623.178528:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5489 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5482 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.178547:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5482 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.178558:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5482 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.178567:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b800, rc 0) 00000100:00100000:1.0:1788211623.178594:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660796672:12345-0@lo:101: Request processed in 85us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.178599:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788211623.178624:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660796672:0@lo:101: 00010000:00010000:1.0:1788211623.178640:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.178648:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211623.178687:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660796800:0@lo:256: 00000100:00100000:1.0:1788211623.178718:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211623.178730:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4ad9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788211623.178741:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660796800 00000100:00100000:1.0:1788211623.178743:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660796800 00000100:00100000:1.0:1788211623.184610:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788211623.184641:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660796800:12345-0@lo:256: 20000000:01000000:1.0:1788211623.184745:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788211623.184775:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788211623.184779:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788211623.184924:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660796800:12345-0@lo:256: Request processed in 300us (6203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.184932:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788211623.184995:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660796800:0@lo:256: 10000000:01000000:1.0:1788211623.186322:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788211623.186338:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.186350:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211623.186360:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788211623.186370:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788211623.186373:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788211623.186410:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.186418:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211623.186428:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211623.186451:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660796928:0@lo:101: 00000100:00100000:0.0:1788211623.198097:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211623.198148:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4ad9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788211623.199857:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660796928 00000100:00100000:2.0:1788211623.199873:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660796928 00000100:00100000:2.0:1788211623.199943:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788211623.199954:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660796928:12345-0@lo:101: 00010000:00010000:2.0:1788211623.199972:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211623.199992:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a5497 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5490 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.200022:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a5497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5490 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.200033:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a5497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5490 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.200067:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4a00, rc 0) 00000100:00100000:2.0:1788211623.200146:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660796928:12345-0@lo:101: Request processed in 194us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211623.200153:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788211623.204694:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660796928:0@lo:101: 00010000:00010000:2.0:1788211623.204727:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.204742:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211623.204830:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660797056:0@lo:501: 00000100:00100000:2.0:1788211623.204895:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211623.204936:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211623.204955:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660797056 00000100:00100000:2.0:1788211623.204960:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660797056 00000100:00100000:2.0:1788211623.205003:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788211623.205013:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660797056:12345-0@lo:501: 00000100:00100000:2.0:1788211623.205339:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660797056:12345-0@lo:501: Request processed in 326us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211623.205348:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788211623.205394:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660797056:0@lo:501: 00000100:00100000:2.0:1788211623.205423:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660797184:0@lo:503: 00000100:00100000:2.0:1788211623.205473:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211623.205491:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211623.205510:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660797184 00000100:00100000:2.0:1788211623.205513:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660797184 00000100:00100000:2.0:1788211623.205535:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788211623.205542:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660797184:12345-0@lo:503: 00000100:00100000:2.0:1788211623.205821:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660797184:12345-0@lo:503: Request processed in 278us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211623.205829:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788211623.205870:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660797184:0@lo:503: 00000100:00100000:3.0:1788211623.208264:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7938:1875075660797312:0@lo:502: 00000100:00100000:3.0:1788211623.208391:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211623.208438:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b46840 going to sleep for 11 seconds 00000100:00100000:2.0:1788211623.208586:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660797312 00000100:00100000:2.0:1788211623.208599:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660797312 00000100:00100000:2.0:1788211623.208739:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788211623.208754:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+18:7938:x1875075660797312:12345-0@lo:502: 00000100:00100000:2.0:1788211623.209207:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+18:7938:x1875075660797312:12345-0@lo:502: Request processed in 456us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211623.209218:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788211623.209741:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7938:1875075660797312:0@lo:502: 00000020:01000000:0.0:1788211623.209785:0:7938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788211623.209794:0:7938:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788211623.209850:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211623.209853:0:7938:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788211623.209859:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788211623.209864:0:7938:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.129@tcp to nid 0x20000c0a8cc81 (192.168.204.129@tcp) 00000020:01000000:0.0:1788211623.209892:0:7938:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788211623.209895:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788211623.209914:0:7938:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8abfd2a1b370) 00000020:00000080:0.0:1788211623.209940:0:7938:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788211623.209946:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788211623.210029:0:7938:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788211623.210046:0:7938:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788211623.210056:0:7938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a54a5 00010000:00080000:0.0:1788211623.210092:0:7938:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abec5af8000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:0.0:1788211623.210366:0:7938:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788211623.211236:0:7938:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788211623.211250:0:7938:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788211623.211919:0:7938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788211623.212161:0:7938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788211623.212236:0:7938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788211623.212296:0:7938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788211623.213029:0:7939:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788211623.213047:0:7939:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788211623.213893:0:7938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788211623.213905:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788211623.213939:0:7938:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788211623.213961:0:7938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a54ac 00000100:00080000:0.0:1788211623.213971:0:7938:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788211623.213977:0:7938:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8abec5af8000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1788211623.214013:0:7938:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abffdb92d80 x1875075660797440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788211623.214089:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660797440:0@lo:8: 00000100:00100000:2.0:1788211623.214207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788211623.214425:0:7938:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788211623.214494:0:7938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211623.214499:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211623.214501:0:7938:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788211623.214503:0:7938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211623.214507:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211623.214508:0:7938:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788211623.214510:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788211623.214512:0:7938:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788211623.214536:0:7938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb90e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7938:1875075660797568:0@lo:502: 00000100:00100000:0.0:1788211623.214583:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211623.214599:0:7938:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec67526c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211623.214912:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660798080:0@lo:400: 00000100:00100000:3.0:1788211623.214965:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211623.214991:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788211623.214998:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660797696:0@lo:400: 00000100:00100000:3.0:1788211623.215019:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211623.215359:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660797824:0@lo:400: 00000100:00100000:1.0:1788211623.215392:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211623.215413:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211623.215419:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660797952:0@lo:400: 00000100:00100000:1.0:1788211623.215443:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211623.215486:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660798080 00000100:00100000:1.0:1788211623.215493:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660798080 00000100:00100000:1.0:1788211623.215542:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660797696 00000100:00100000:1.0:1788211623.215544:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660797696 00000100:00100000:1.0:1788211623.215558:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660797824 00000100:00100000:1.0:1788211623.215560:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660797824 00000100:00100000:1.0:1788211623.215576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788211623.215585:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660798080:12345-0@lo:400: 00000100:00100000:1.0:1788211623.215634:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660798080:12345-0@lo:400: Request processed in 50us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.215642:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788211623.215792:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788211623.215811:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660797696:12345-0@lo:400: 00000100:00100000:0.0:1788211623.215851:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660797696:12345-0@lo:400: Request processed in 48us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211623.215869:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788211623.215885:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788211623.215891:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660797824:12345-0@lo:400: 00000100:00100000:0.0:1788211623.215926:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660797824:12345-0@lo:400: Request processed in 34us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211623.215932:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788211623.216025:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660797440 00000100:00100000:1.0:1788211623.216047:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660797440 00000100:00100000:1.0:1788211623.216069:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660797952 00000100:00100000:1.0:1788211623.216072:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660797952 00000100:00100000:1.0:1788211623.216092:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788211623.216099:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660797952:12345-0@lo:400: 00000100:00100000:1.0:1788211623.216130:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660797952:12345-0@lo:400: Request processed in 32us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.216136:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788211623.216145:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788211623.216149:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875075660797440:12345-0@lo:8: 00010000:00080000:1.0:1788211623.216201:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:1.0:1788211623.216236:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a54b3 00002000:00100000:1.0:1788211623.216250:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8abfcaf35800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788211623.216255:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788211623.216259:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788211623.216386:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788211623.216616:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788211623.216719:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8abfcaf31800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788211623.216951:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788211623.216956:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211623.220786:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875075660797440:12345-0@lo:8: Request processed in 4624us (6612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.220811:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788211623.220881:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abff6462680 x1875075660797696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211623.220897:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660797696:0@lo:400: 00010000:00080000:1.0:1788211623.220910:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abff6463100 x1875075660798080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211623.220934:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660798080:0@lo:400: 00010000:00080000:1.0:1788211623.220980:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abff6463800 x1875075660797952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211623.220988:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660797952:0@lo:400: 00010000:00080000:1.0:1788211623.220999:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abff6462300 x1875075660797824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211623.221005:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660797824:0@lo:400: 00010000:00080000:2.0:1788211623.223988:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffdb92d80 x1875075660797440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788211633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211623.224004:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788211623.224014:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788211623.224024:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788211623.224031:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788211623.224034:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec5af8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788211623.225540:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788211623.225555:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660797440:0@lo:8: 00000100:00100000:2.0:1788211623.225620:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660797568 00000100:00100000:2.0:1788211623.225630:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660797568 00000100:00100000:2.0:1788211623.225683:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788211623.225693:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:7938:x1875075660797568:12345-0@lo:502: 00000100:00100000:2.0:1788211623.226003:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:7938:x1875075660797568:12345-0@lo:502: Request processed in 310us (11418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211623.226011:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788211623.226095:0:7938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb90e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:7938:1875075660797568:0@lo:502: 00000020:01000000:2.0:1788211623.226132:0:7938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211623.226140:0:7938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211623.226142:0:7938:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788211623.226148:0:7938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788211623.226231:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788211623.226251:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788211623.226262:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.226273:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211623.226282:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788211623.226285:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8abfca8a4d28 from 1 10000000:01000000:2.0:1788211623.226288:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788211623.226318:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.226327:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.226347:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211623.226365:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660798208:0@lo:101: 00000100:00100000:2.0:1788211623.226404:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211623.226438:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211623.226467:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660798208 00000100:00100000:2.0:1788211623.226471:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660798208 00000100:00100000:2.0:1788211623.226494:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788211623.226501:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660798208:12345-0@lo:101: 00010000:00010000:2.0:1788211623.226510:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211623.226522:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a54c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a54ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.226544:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a54c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a54ba expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.226553:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a54c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a54ba expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.226562:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4600, rc 0) 00000100:00100000:2.0:1788211623.226590:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660798208:12345-0@lo:101: Request processed in 89us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211623.226596:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788211623.226627:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660798208:0@lo:101: 00010000:00010000:2.0:1788211623.226639:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a54c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.226659:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a54c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211623.226706:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660798336:0@lo:501: 00000100:00100000:2.0:1788211623.226728:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211623.226741:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211623.226751:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660798336 00000100:00100000:2.0:1788211623.226754:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660798336 00000100:00100000:2.0:1788211623.226776:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788211623.226782:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660798336:12345-0@lo:501: 00000100:00100000:2.0:1788211623.227005:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660798336:12345-0@lo:501: Request processed in 223us (275us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788211623.227012:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788211623.227054:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660798336:0@lo:501: 10000000:01000000:2.0:1788211623.227074:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788211623.227079:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a54c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211623.227086:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a54c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788211623.227204:0:7939:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788211623.227324:0:7939:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 212533157129ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788211623.330245:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788211623.387736:0:7940:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788211623.387784:0:7940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875075660798592:0@lo:7: 00000100:00100000:0.0:1788211623.388085:0:7940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211623.388214:0:7940:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104000 going to sleep for 11 seconds 00000100:00100000:0.0:1788211623.388252:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660798464:0@lo:13: 00000100:00100000:0.0:1788211623.388280:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211623.393009:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660798464 00000100:00100000:1.0:1788211623.393044:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660798464 00000100:00100000:1.0:1788211623.393141:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788211623.393154:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875075660798464:12345-0@lo:13: 00002000:00000024:1.0:1788211623.393222:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788211623.393317:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875075660798464:12345-0@lo:13: Request processed in 166us (5036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211623.393325:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788211623.393411:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788211623.393463:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffdb91880 x1875075660798464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211623.393486:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660798464:0@lo:13: 00000100:00100000:3.0:1788211623.397069:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660798592 00000100:00100000:3.0:1788211623.397089:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660798592 00000100:00100000:3.0:1788211623.397574:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788211623.397599:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7940:x1875075660798592:12345-0@lo:7: 00002000:00080000:3.0:1788211623.412131:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788211623.412144:0:6695:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788211623.412362:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7940:x1875075660798592:12345-0@lo:7: Request processed in 14759us (24271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211623.412377:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788211623.414968:0:7940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffdb91f80 x1875075660798592/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788211639 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211623.414999:0:7940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875075660798592:0@lo:7: 00000004:00080000:0.0:1788211623.415018:0:7940:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788211623.415088:0:7940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875075660798720:0@lo:5: 00000100:00100000:0.0:1788211623.415163:0:7940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211623.415237:0:7940:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104000 going to sleep for 11 seconds 00000100:00100000:1.0:1788211623.415319:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660798720 00000100:00100000:1.0:1788211623.415326:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660798720 00000100:00100000:1.0:1788211623.415388:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788211623.415398:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7940:x1875075660798720:12345-0@lo:5: 00002000:00080000:1.0:1788211623.415433:0:6693:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788211623.415437:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788211623.415886:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7940:x1875075660798720:12345-0@lo:5: Request processed in 489us (722us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788211623.415894:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788211623.417672:0:7940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffdb91f80 x1875075660798720/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788211639 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211623.417702:0:7940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875075660798720:0@lo:5: 00000004:00080000:2.0:1788211623.417739:0:7940:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788211623.417794:0:7940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875075660798848:0@lo:700: 00000100:00100000:2.0:1788211623.417850:0:7940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211623.417882:0:7940:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788211623.417903:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660798848 00000100:00100000:2.0:1788211623.417909:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660798848 00000100:00100000:2.0:1788211623.417954:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211623.417964:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7940:x1875075660798848:12345-0@lo:700: 00000100:00100000:2.0:1788211623.418005:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6702:1875075660798976:0@lo:700: 00000100:00100000:2.0:1788211623.418067:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211623.418084:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211623.418102:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660798976 00000100:00100000:2.0:1788211623.418105:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660798976 00000100:00100000:2.0:1788211623.418129:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211623.418136:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6702:x1875075660798976:12345-0@lo:700: 40000000:02000000:2.0:1788211623.481103:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788211623.488923:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6702:x1875075660798976:12345-0@lo:700: Request processed in 70778us (70845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211623.488940:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788211623.490883:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfefac4000 x1875075660798976/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788211639 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211623.490902:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6702:1875075660798976:0@lo:700: 40000000:02000000:3.0:1788211623.490919:0:6702:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1788211623.648963:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1788211623.649120:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:7940:x1875075660798848:12345-0@lo:700: Request processed in 231150us (231262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211623.649134:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:2.0:1788211623.650498:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1788211623.650729:0:7940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfefac5880 x1875075660798848/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788211639 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211623.650746:0:7940:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788211623.650773:0:7940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875075660798848:0@lo:700: 00000004:02000040:2.0:1788211623.752896:0:7940:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788211623.757078:0:7940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875075660799104:0@lo:5: 00000100:00100000:2.0:1788211623.757156:0:7940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211623.762343:0:7940:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffde3d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211623.768015:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660799104 00000100:00100000:3.0:1788211623.768045:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660799104 00000100:00100000:2.0:1788211623.768452:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788211623.768465:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7940:x1875075660799104:12345-0@lo:5: 00002000:00080000:0.0:1788211623.779622:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788211623.786105:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788211623.795974:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7940:x1875075660799104:12345-0@lo:5: Request processed in 27497us (38803us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788211623.795992:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788211623.796125:0:7940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfefac5880 x1875075660799104/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788211639 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211623.796146:0:7940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7940:1875075660799104:0@lo:5: 00000004:00080000:3.0:1788211623.796162:0:7940:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788211624.110131:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788211624.697042:0:8002:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788211625.128639:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211626.150286:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211627.174201:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211627.755301:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660799232:0@lo:13: 00000100:00100000:2.0:1788211627.755412:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211627.755654:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660799232 00000100:00100000:3.0:1788211627.755664:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660799232 00000100:00100000:3.0:1788211627.755743:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788211627.755754:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660799232:12345-0@lo:13: 00002000:00000024:3.0:1788211627.755797:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788211627.755876:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788211627.763227:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660799232:12345-0@lo:13: Request processed in 7457us (7799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211627.763250:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788211627.763465:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca8b4000 x1875075660799232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211627.763494:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660799232:0@lo:13: 00010000:00010000:0.0:1788211628.202896:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211628.263888:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660799744:0@lo:400: 00000100:00100000:1.0:1788211628.263888:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660799360:0@lo:400: 00000100:00100000:3.0:1788211628.266150:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211628.266278:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660799488:0@lo:400: 00000100:00100000:3.0:1788211628.266332:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211628.267678:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211628.267748:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660799872:0@lo:400: 00000100:00100000:1.0:1788211628.267799:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211628.267902:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660799360 00000100:00100000:1.0:1788211628.267913:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660799360 00000100:00100000:1.0:1788211628.267991:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788211628.268005:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3309:x1875075660799360:12345-0@lo:400: 00000100:00100000:1.0:1788211628.268073:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3309:x1875075660799360:12345-0@lo:400: Request processed in 72us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211628.268082:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788211628.268138:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660799360:0@lo:400: 00000100:00100000:3.0:1788211628.270906:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788211628.270927:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660799616:0@lo:400: 00000100:00100000:3.0:1788211628.271024:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211628.271237:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660799872 00000100:00100000:0.0:1788211628.271247:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660799872 00000100:00100000:0.0:1788211628.271315:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788211628.271324:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875075660799872:12345-0@lo:400: 00000100:00100000:0.0:1788211628.271416:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875075660799872:12345-0@lo:400: Request processed in 91us (3614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211628.271424:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788211628.271449:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788211628.271490:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abff6463100 x1875075660799872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211628.271507:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660799872:0@lo:400: 00000100:00100000:0.0:1788211628.271677:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660799744 00000100:00100000:0.0:1788211628.271682:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660799744 00000100:00100000:0.0:1788211628.271739:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660799488 00000100:00100000:0.0:1788211628.271743:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660799488 00000100:00100000:0.0:1788211628.271777:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660799616 00000100:00100000:0.0:1788211628.271780:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660799616 00000100:00100000:0.0:1788211628.271797:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788211628.271804:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660799744:12345-0@lo:400: 00000100:00100000:0.0:1788211628.271849:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660799744:12345-0@lo:400: Request processed in 45us (5706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211628.271855:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788211628.271867:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788211628.271873:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660799488:12345-0@lo:400: 00000100:00100000:0.0:1788211628.271907:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660799488:12345-0@lo:400: Request processed in 34us (5575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211628.271914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788211628.271925:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788211628.271931:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660799616:12345-0@lo:400: 00000100:00100000:0.0:1788211628.271975:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660799616:12345-0@lo:400: Request processed in 44us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211628.271981:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788211628.272004:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788211628.273971:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abff6463800 x1875075660799744/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211628.273994:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660799744:0@lo:400: 00010000:00080000:2.0:1788211628.275499:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abff6462300 x1875075660799616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211628.275515:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660799616:0@lo:400: 00010000:00080000:2.0:1788211628.275531:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abff6460380 x1875075660799488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211628.275540:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660799488:0@lo:400: 00000100:00100000:3.0:1788211628.777242:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788211628.777271:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660800000:0@lo:13: 00000100:00100000:3.0:1788211628.777343:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211628.777658:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660800000 00000100:00100000:1.0:1788211628.777666:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660800000 00000100:00100000:1.0:1788211628.777714:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788211628.777724:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875075660800000:12345-0@lo:13: 00002000:00000024:1.0:1788211628.777759:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211628.777807:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875075660800000:12345-0@lo:13: Request processed in 85us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211628.777814:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788211628.777865:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001365180 x1875075660800000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211628.777886:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660800000:0@lo:13: 00000001:00080000:2.0:1788211628.857014:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788211629.221663:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211630.248149:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211631.270786:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211631.317579:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211631.318492:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637706880 00000100:00100000:2.0:1788211631.318508:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637706880 00000100:00100000:2.0:1788211631.318571:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 111 00000100:00100000:2.0:1788211631.318580:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2357:x1875075637706880:12345-192.168.204.29@tcp:250: 00010000:00080000:2.0:1788211631.318609:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab@192.168.204.29@tcp t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1788211631.318640:0:5836:0:(genops.c:1385:class_connect()) connect: client d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab, cookie 0x2afbce82f55a54c8 00000100:00080000:2.0:1788211631.318820:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8abec6690000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211631.318917:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+5:2357:x1875075637706880:12345-192.168.204.29@tcp:250: Request processed in 336us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211631.318925:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 111 00000100:00100000:1.0:1788211631.334264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211631.334504:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637707008 00000100:00100000:2.0:1788211631.334518:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637707008 00000100:00100000:2.0:1788211631.334578:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 112 00000100:00100000:2.0:1788211631.334589:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+5:5588:x1875075637707008:12345-192.168.204.29@tcp:101: 00010000:00010000:2.0:1788211631.334607:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211631.334628:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a54cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f56de expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211631.334661:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a54cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56de expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211631.334673:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a54cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56de expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211631.334684:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c5a00, rc 0) 00000100:00100000:2.0:1788211631.334929:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+6:5588:x1875075637707008:12345-192.168.204.29@tcp:101: Request processed in 340us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211631.334935:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 112 00000100:00100000:3.0:1788211631.341709:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211631.341750:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637707136 00000100:00100000:3.0:1788211631.341761:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637707136 00000100:00100000:3.0:1788211631.342002:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 113 00000100:00100000:3.0:1788211631.342013:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+6:5588:x1875075637707136:12345-192.168.204.29@tcp:501: 00000100:00100000:3.0:1788211631.343035:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+6:5588:x1875075637707136:12345-192.168.204.29@tcp:501: Request processed in 1017us (1331us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788211631.343046:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 113 00000100:00100000:2.0:1788211631.348475:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211631.349417:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637707264 00000100:00100000:2.0:1788211631.349437:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637707264 00000100:00100000:2.0:1788211631.349552:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 114 00000100:00100000:2.0:1788211631.349565:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+6:5588:x1875075637707264:12345-192.168.204.29@tcp:101: 00010000:00010000:2.0:1788211631.349600:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211631.349630:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a54d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f56e5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211631.349668:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a54d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56e5 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211631.349682:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a54d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56e5 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211631.349693:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4000, rc 0) 00000100:00100000:2.0:1788211631.349781:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+7:5588:x1875075637707264:12345-192.168.204.29@tcp:101: Request processed in 219us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211631.349788:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 114 00000100:00100000:1.0:1788211631.358857:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211631.358945:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637707392 00000100:00100000:3.0:1788211631.358958:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637707392 00000100:00100000:3.0:1788211631.359034:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 115 00000100:00100000:3.0:1788211631.359047:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+7:5588:x1875075637707392:12345-192.168.204.29@tcp:501: 00000100:00100000:3.0:1788211631.359517:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+8:5588:x1875075637707392:12345-192.168.204.29@tcp:501: Request processed in 469us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211631.359528:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 115 00000100:00100000:0.0:1788211631.365120:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211631.365264:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637707520 00000100:00100000:2.0:1788211631.365282:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637707520 00000100:00100000:2.0:1788211631.365346:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:2.0:1788211631.365358:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+8:5588:x1875075637707520:12345-192.168.204.29@tcp:503: 00000100:00100000:2.0:1788211631.365711:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+8:5588:x1875075637707520:12345-192.168.204.29@tcp:503: Request processed in 354us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211631.365720:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:3.0:1788211631.370578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211631.370656:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637707648 00000100:00100000:2.0:1788211631.370667:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637707648 00000100:00100000:2.0:1788211631.370783:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 117 00000100:00100000:2.0:1788211631.370810:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+8:5606:x1875075637707648:12345-192.168.204.29@tcp:502: 00000100:00100000:2.0:1788211631.371368:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+8:5606:x1875075637707648:12345-192.168.204.29@tcp:502: Request processed in 557us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211631.371379:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 117 00000100:00100000:3.0:1788211631.400636:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211631.401904:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637707776 00000100:00100000:2.0:1788211631.401928:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637707776 00000100:00100000:2.0:1788211631.402012:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:2.0:1788211631.402028:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+8:5606:x1875075637707776:12345-192.168.204.29@tcp:502: 00000100:00100000:2.0:1788211631.402492:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+8:5606:x1875075637707776:12345-192.168.204.29@tcp:502: Request processed in 467us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211631.402895:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:0.0:1788211631.411222:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211631.411447:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637707904 00000100:00100000:1.0:1788211631.411463:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637707904 00000100:00100000:1.0:1788211631.411548:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 119 00000100:00100000:1.0:1788211631.411561:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+8:5588:x1875075637707904:12345-192.168.204.29@tcp:101: 00010000:00010000:1.0:1788211631.411585:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211631.411608:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a54dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f570f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211631.411643:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a54dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f570f expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211631.411655:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a54dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f570f expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211631.411666:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37ac00, rc 0) 00000100:00100000:1.0:1788211631.411903:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:5588:x1875075637707904:12345-192.168.204.29@tcp:101: Request processed in 342us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211631.411910:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 119 00000100:00100000:3.0:1788211631.416331:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211631.419788:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637708032 00000100:00100000:2.0:1788211631.419954:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637708032 00000100:00100000:2.0:1788211631.420031:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:2.0:1788211631.420047:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:5588:x1875075637708032:12345-192.168.204.29@tcp:256: 20000000:01000000:2.0:1788211631.420082:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788211631.420107:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788211631.420111:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788211631.420115:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788211631.420117:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788211631.424142:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:5588:x1875075637708032:12345-192.168.204.29@tcp:256: Request processed in 4081us (7829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211631.424163:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:1.0:1788211631.427750:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211631.427821:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637708160 00000100:00100000:1.0:1788211631.427848:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637708160 00000100:00100000:1.0:1788211631.427924:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:1.0:1788211631.427936:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:5588:x1875075637708160:12345-192.168.204.29@tcp:101: 00010000:00010000:1.0:1788211631.427980:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211631.428006:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37a800/0x2afbce82f55a54e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5716 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211631.428054:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37a800/0x2afbce82f55a54e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5716 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211631.428067:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37a800/0x2afbce82f55a54e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5716 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211631.428080:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37a800, rc 0) 00000100:00100000:1.0:1788211631.428154:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5588:x1875075637708160:12345-192.168.204.29@tcp:101: Request processed in 221us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211631.428162:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:3.0:1788211631.431497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211631.431699:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637708288 00000100:00100000:0.0:1788211631.431713:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637708288 00000100:00100000:0.0:1788211631.431792:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 122 00000100:00100000:0.0:1788211631.431818:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5588:x1875075637708288:12345-192.168.204.29@tcp:501: 00000100:00100000:0.0:1788211631.432599:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5588:x1875075637708288:12345-192.168.204.29@tcp:501: Request processed in 790us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211631.432609:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 122 00000100:00100000:0.0:1788211631.437013:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211631.437211:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637708416 00000100:00100000:1.0:1788211631.437226:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637708416 00000100:00100000:1.0:1788211631.437420:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 123 00000100:00100000:1.0:1788211631.437433:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5588:x1875075637708416:12345-192.168.204.29@tcp:503: 00000100:00100000:1.0:1788211631.437927:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5588:x1875075637708416:12345-192.168.204.29@tcp:503: Request processed in 496us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211631.437936:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 123 00000100:00100000:1.0:1788211631.445100:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211631.445641:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637708544 00000100:00100000:0.0:1788211631.445653:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637708544 00000100:00100000:0.0:1788211631.445714:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 124 00000100:00100000:0.0:1788211631.445725:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5611:x1875075637708544:12345-192.168.204.29@tcp:502: 00000100:00100000:0.0:1788211631.446069:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5611:x1875075637708544:12345-192.168.204.29@tcp:502: Request processed in 345us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211631.446077:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 124 00000100:00100000:3.0:1788211631.448786:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211631.448900:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637708672 00000100:00100000:2.0:1788211631.448911:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637708672 00000100:00100000:2.0:1788211631.448979:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 125 00000100:00100000:2.0:1788211631.448992:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5611:x1875075637708672:12345-192.168.204.29@tcp:502: 00000100:00100000:2.0:1788211631.449520:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5611:x1875075637708672:12345-192.168.204.29@tcp:502: Request processed in 526us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211631.449545:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 125 00000100:00100000:3.0:1788211631.455540:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211631.455589:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637708800 00000100:00100000:3.0:1788211631.455602:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637708800 00000100:00100000:3.0:1788211631.455648:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:3.0:1788211631.455659:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1875075637708800:12345-192.168.204.29@tcp:38: 00010000:00080000:3.0:1788211631.455694:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1788211631.455752:0:5844:0:(genops.c:1385:class_connect()) connect: client a688ef06-7eb0-4c47-9425-de9843f5c0e0, cookie 0x2afbce82f55a54eb 00000004:00100000:3.0:1788211631.455782:0:5844:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788211631.455787:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788211631.499661:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8abec67d4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788211631.499786:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2357:x1875075637708800:12345-192.168.204.29@tcp:38: Request processed in 44125us (44258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211631.499808:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00010000:00010000:1.0:1788211632.298461:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211632.515877:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211632.515923:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211632.516011:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637708928 00000100:00100000:0.0:1788211632.516022:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637708928 00000100:00100000:0.0:1788211632.516233:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637709056 00000100:00100000:0.0:1788211632.516238:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637709056 00000100:00080000:1.0:1788211632.516297:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211632.517797:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:0.0:1788211632.517823:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:0:x1875075637708928:12345-192.168.204.29@tcp:41: 00000004:00000024:0.0:1788211632.517884:0:6717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788211632.517973:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:0:x1875075637708928:12345-192.168.204.29@tcp:41: Request processed in 162us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211632.517981:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:0.0:1788211632.518002:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:0.0:1788211632.518009:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:5588:x1875075637709056:12345-192.168.204.29@tcp:41: 00000004:00000024:0.0:1788211632.518021:0:6717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788211632.518041:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:5588:x1875075637709056:12345-192.168.204.29@tcp:41: Request processed in 32us (2118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211632.518046:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:1.0:1788211632.532520:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211632.532742:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637709184 00000100:00100000:2.0:1788211632.532758:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637709184 00000100:00100000:2.0:1788211632.532829:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:2.0:1788211632.532841:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:5588:x1875075637709184:12345-192.168.204.29@tcp:40: 00000100:00100000:2.0:1788211632.532955:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:5588:x1875075637709184:12345-192.168.204.29@tcp:40: Request processed in 117us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211632.532963:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:2.0:1788211632.539339:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211632.539407:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211632.539640:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637709568 00000100:00100000:0.0:1788211632.539651:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637709568 00000100:00100000:0.0:1788211632.539720:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:0.0:1788211632.539747:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:5588:x1875075637709568:12345-192.168.204.29@tcp:33: 00000100:00100000:1.0:1788211632.542094:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637709696 00000100:00100000:1.0:1788211632.542125:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637709696 00000100:00100000:1.0:1788211632.542217:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 126 00000100:00100000:1.0:1788211632.542227:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2359:x1875075637709696:12345-192.168.204.29@tcp:400: 00000100:00100000:1.0:1788211632.542337:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2359:x1875075637709696:12345-192.168.204.29@tcp:400: Request processed in 111us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211632.542345:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 126 00000100:00100000:1.0:1788211632.554960:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211632.558558:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211632.558634:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637709312 00000100:00100000:1.0:1788211632.558645:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637709312 00000100:00100000:1.0:1788211632.558696:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637709440 00000100:00100000:1.0:1788211632.558700:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637709440 00000100:00100000:1.0:1788211632.558717:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:1.0:1788211632.558726:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875075637709312:12345-192.168.204.29@tcp:8: 00010000:00080000:1.0:1788211632.558759:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:1.0:1788211632.558794:0:6696:0:(genops.c:1385:class_connect()) connect: client a688ef06-7eb0-4c47-9425-de9843f5c0e0, cookie 0x2afbce82f55a54f2 00002000:00100000:1.0:1788211632.558806:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a688ef06-7eb0-4c47-9425-de9843f5c0e0/ffff8abec584e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788211632.558833:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788211632.559222:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788211632.559253:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8abec584a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788211632.559331:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2357:x1875075637709312:12345-192.168.204.29@tcp:8: Request processed in 604us (4383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211632.559339:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:2.0:1788211632.563545:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1788211632.563562:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875075637709440:12345-192.168.204.29@tcp:8: 00010000:00080000:2.0:1788211632.563606:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1788211632.563664:0:6693:0:(genops.c:1385:class_connect()) connect: client a688ef06-7eb0-4c47-9425-de9843f5c0e0, cookie 0x2afbce82f55a54f9 00002000:00100000:2.0:1788211632.563681:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a688ef06-7eb0-4c47-9425-de9843f5c0e0/ffff8abec6696800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788211632.563713:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788211632.564124:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788211632.564158:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8abec6697000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211632.564266:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2357:x1875075637709440:12345-192.168.204.29@tcp:8: Request processed in 705us (5722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211632.564274:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000004:00080000:1.0:1788211632.614672:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 74830us 00000004:00200000:1.0:1788211632.634214:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788211632.634441:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:5588:x1875075637709568:12345-192.168.204.29@tcp:33: Request processed in 94688us (95106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211632.634466:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:2.0:1788211632.870719:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660800128:0@lo:13: 00000100:00100000:2.0:1788211632.870844:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211632.871110:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660800128 00000100:00100000:1.0:1788211632.871120:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660800128 00000100:00100000:1.0:1788211632.871215:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788211632.871226:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660800128:12345-0@lo:13: 00002000:00000024:1.0:1788211632.871249:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211632.871315:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660800128:12345-0@lo:13: Request processed in 91us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211632.871322:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788211632.871386:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abff6460380 x1875075660800128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211632.871408:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660800128:0@lo:13: 00000100:00080000:2.0:1788211632.871660:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788211632.942578:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211632.942716:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637709824 00000100:00100000:1.0:1788211632.942730:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637709824 00000100:00100000:1.0:1788211632.942800:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:1.0:1788211632.942811:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:5628:x1875075637709824:12345-192.168.204.29@tcp:101: 00010000:00010000:1.0:1788211632.942864:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211632.942906:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5740 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211632.943054:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5507 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211632.943068:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211632.943084:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211632.943349:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788211632.943353:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788211632.943424:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211632.943452:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5740 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211632.943470:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5507 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5740 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211632.943479:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec800) 00010000:00010000:1.0:1788211632.943482:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788211632.943485:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07400, rc 0) 00000100:00100000:1.0:1788211632.943560:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:5628:x1875075637709824:12345-192.168.204.29@tcp:101: Request processed in 751us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211632.943568:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00010000:00010000:3.0:1788211633.319682:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211633.382033:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660800640:0@lo:400: 00000100:00100000:3.0:1788211633.382142:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211633.382401:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788211633.382409:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660800512:0@lo:400: 00000100:00100000:3.0:1788211633.382435:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211633.382537:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660800640 00000100:00100000:3.0:1788211633.382547:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660800640 00000100:00100000:3.0:1788211633.382604:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660800512 00000100:00100000:3.0:1788211633.383003:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660800512 00000100:00100000:3.0:1788211633.383046:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788211633.383055:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660800640:12345-0@lo:400: 00000100:00100000:3.0:1788211633.383116:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660800640:12345-0@lo:400: Request processed in 62us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211633.383123:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788211633.383141:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788211633.383147:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660800512:12345-0@lo:400: 00000100:00100000:3.0:1788211633.383201:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660800512:12345-0@lo:400: Request processed in 55us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211633.383208:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788211633.383233:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211633.383264:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660800512:0@lo:400: 00000100:00100000:3.0:1788211633.383279:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660800640:0@lo:400: 00000100:00100000:0.0:1788211633.383523:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660800384:0@lo:400: 00000100:00100000:0.0:1788211633.383559:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211633.383589:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788211633.383596:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660800256:0@lo:400: 00000100:00100000:0.0:1788211633.383622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211633.383654:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660800768:0@lo:400: 00000100:00100000:0.0:1788211633.383677:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211633.383704:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660800768 00000100:00100000:0.0:1788211633.383708:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660800768 00000100:00100000:0.0:1788211633.383740:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788211633.383746:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660800768:12345-0@lo:400: 00000100:00100000:0.0:1788211633.383778:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660800768:12345-0@lo:400: Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211633.383783:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788211633.383808:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001367b80 x1875075660800768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211633.383830:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788211633.383857:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660800768:0@lo:400: 00000100:00100000:2.0:1788211633.384953:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660800256 00000100:00100000:2.0:1788211633.384963:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660800256 00000100:00100000:2.0:1788211633.385009:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788211633.385017:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3309:x1875075660800256:12345-0@lo:400: 00000100:00100000:2.0:1788211633.385088:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3309:x1875075660800256:12345-0@lo:400: Request processed in 70us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211633.385096:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788211633.385266:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660800384 00000100:00100000:1.0:1788211633.385272:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660800384 00000100:00100000:1.0:1788211633.385312:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788211633.385320:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660800384:12345-0@lo:400: 00000100:00100000:1.0:1788211633.385373:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660800384:12345-0@lo:400: Request processed in 54us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211633.385378:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788211633.385813:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788211633.387342:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660800256:0@lo:400: 00000100:00100000:0.0:1788211633.387390:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660800384:0@lo:400: 00000100:00100000:1.0:1788211633.894452:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211633.894494:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660800896:0@lo:13: 00000100:00100000:1.0:1788211633.894624:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211633.894863:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660800896 00000100:00100000:3.0:1788211633.894873:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660800896 00000100:00100000:3.0:1788211633.894934:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788211633.894945:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660800896:12345-0@lo:13: 00002000:00000024:3.0:1788211633.895002:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211633.895067:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660800896:12345-0@lo:13: Request processed in 124us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211633.895074:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788211633.895125:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001364380 x1875075660800896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211633.895148:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660800896:0@lo:13: 00000001:00100000:2.0:1788211633.969423:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a688ef06-7eb0-4c47-9425-de9843f5c0e0 00010000:00010000:1.0:1788211634.344570:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211635.279850:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211635.280015:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637709952 00000100:00100000:3.0:1788211635.280029:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637709952 00000100:00080000:0.0:1788211635.280197:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211635.280443:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:3.0:1788211635.280460:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:5681:x1875075637709952:12345-192.168.204.29@tcp:41: 00000004:00000024:3.0:1788211635.280535:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788211635.280621:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:5681:x1875075637709952:12345-192.168.204.29@tcp:41: Request processed in 167us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211635.280629:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1788211635.291759:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211635.291936:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637710080 00000100:00100000:3.0:1788211635.291950:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637710080 00000100:00100000:3.0:1788211635.292035:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:3.0:1788211635.292049:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:5681:x1875075637710080:12345-192.168.204.29@tcp:13: 00002000:00000024:3.0:1788211635.292101:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788211635.292327:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788211635.292379:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:5681:x1875075637710080:12345-192.168.204.29@tcp:13: Request processed in 331us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211635.292387:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:0.0:1788211635.298977:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211635.302826:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637710208 00000100:00100000:3.0:1788211635.302844:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637710208 00000100:00100000:3.0:1788211635.303025:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:3.0:1788211635.303037:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:5681:x1875075637710208:12345-192.168.204.29@tcp:13: 00002000:00000024:3.0:1788211635.303075:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211635.303196:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:5681:x1875075637710208:12345-192.168.204.29@tcp:13: Request processed in 161us (4238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211635.303205:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00080000:0.0:1788211635.308154:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788211635.366287:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211636.389763:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788211637.019882:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000001:00100000:1.0:1788211637.031626:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a688ef06-7eb0-4c47-9425-de9843f5c0e0 00010000:00010000:3.0:1788211637.413653:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211637.981585:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211637.981630:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211637.981668:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211637.981702:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211637.981852:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637710592 00000100:00100000:1.0:1788211637.981855:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637710336 00000100:00100000:1.0:1788211637.981865:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637710336 00000100:00100000:0.0:1788211637.981865:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637710592 00000100:00100000:0.0:1788211637.981928:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637710720 00000100:00100000:1.0:1788211637.981929:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 128 00000100:00100000:0.0:1788211637.981931:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637710720 00000100:00100000:1.0:1788211637.981941:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc923a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2358:x1875075637710336:12345-192.168.204.29@tcp:400: 00000100:00100000:0.0:1788211637.981958:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:0.0:1788211637.981966:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637710592:12345-192.168.204.29@tcp:400: 00000100:00100000:3.0:1788211637.982024:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637710464 00000100:00100000:1.0:1788211637.982027:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc923a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2358:x1875075637710336:12345-192.168.204.29@tcp:400: Request processed in 88us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211637.982028:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637710464 00000100:00100000:1.0:1788211637.982035:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 128 00000100:00100000:3.0:1788211637.982064:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:3.0:1788211637.982071:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637710464:12345-192.168.204.29@tcp:400: 00000100:00080000:2.0:1788211637.982127:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788211637.982132:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788211637.982134:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788211637.982284:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788211637.982294:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788211637.982312:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788211637.982322:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1788211637.982331:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637710720:12345-192.168.204.29@tcp:400: 00000100:00100000:0.0:1788211637.982404:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637710592:12345-192.168.204.29@tcp:400: Request processed in 437us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211637.982412:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1788211637.984339:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637710464:12345-192.168.204.29@tcp:400: Request processed in 2252us (2653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211637.984360:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:2.0:1788211637.985106:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637710720:12345-192.168.204.29@tcp:400: Request processed in 2612us (3238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211637.985121:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:0.0:1788211637.989805:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660801024:0@lo:13: 00000100:00100000:0.0:1788211637.989923:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211637.990064:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660801024 00000100:00100000:3.0:1788211637.990074:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660801024 00000100:00080000:2.0:1788211637.990142:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788211637.990200:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788211637.990211:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660801024:12345-0@lo:13: 00002000:00000024:3.0:1788211637.990257:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211637.990519:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660801024:12345-0@lo:13: Request processed in 309us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211637.990528:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788211637.990614:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abff6463800 x1875075660801024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211637.990637:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660801024:0@lo:13: 00000001:02000400:0.0:1788211638.272650:0:8309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788211638.437425:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211638.504875:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660801536:0@lo:400: 00000100:00100000:0.0:1788211638.504963:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211638.505029:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788211638.505036:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660801152:0@lo:400: 00000100:00100000:0.0:1788211638.505065:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211638.505085:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660801664:0@lo:400: 00000100:00100000:0.0:1788211638.505109:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211638.505135:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660801280:0@lo:400: 00000100:00100000:0.0:1788211638.505159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211638.505203:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211638.505225:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660801408:0@lo:400: 00000100:00100000:0.0:1788211638.505249:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211638.505282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660801536 00000100:00100000:0.0:1788211638.505291:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660801536 00000100:00100000:0.0:1788211638.505349:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660801280 00000100:00100000:0.0:1788211638.505353:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660801280 00000100:00100000:0.0:1788211638.505365:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660801408 00000100:00100000:0.0:1788211638.505368:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660801408 00000100:00100000:0.0:1788211638.505385:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788211638.505392:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660801536:12345-0@lo:400: 00000100:00100000:0.0:1788211638.505446:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660801536:12345-0@lo:400: Request processed in 54us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211638.505454:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788211638.505470:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788211638.505475:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660801280:12345-0@lo:400: 00000100:00100000:0.0:1788211638.505504:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660801280:12345-0@lo:400: Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211638.505509:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788211638.505519:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788211638.505525:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660801408:12345-0@lo:400: 00000100:00100000:0.0:1788211638.505550:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660801408:12345-0@lo:400: Request processed in 26us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211638.505556:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788211638.505573:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660801664 00000100:00100000:0.0:1788211638.505576:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660801664 00000100:00100000:0.0:1788211638.505601:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788211638.505606:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660801664:12345-0@lo:400: 00000100:00100000:0.0:1788211638.505630:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660801664:12345-0@lo:400: Request processed in 24us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211638.505641:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788211638.505684:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac00107dc00 x1875075660801664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211638.505699:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660801664:0@lo:400: 00000100:00100000:0.0:1788211638.505709:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660801536:0@lo:400: 00000100:00100000:0.0:1788211638.505733:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660801408:0@lo:400: 00000100:00100000:0.0:1788211638.505756:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660801280:0@lo:400: 00000100:00100000:3.0:1788211638.505915:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660801152 00000100:00100000:3.0:1788211638.505920:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660801152 00000100:00100000:3.0:1788211638.505957:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788211638.505964:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660801152:12345-0@lo:400: 00000100:00100000:3.0:1788211638.506007:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660801152:12345-0@lo:400: Request processed in 44us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211638.506013:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1788211638.506243:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211638.506249:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211638.506554:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660801152:0@lo:400: 00000100:00100000:0.0:1788211639.014872:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660801792:0@lo:13: 00000100:00100000:0.0:1788211639.014994:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211639.015158:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660801792 00000100:00100000:1.0:1788211639.015191:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660801792 00000100:00100000:1.0:1788211639.015246:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788211639.015257:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660801792:12345-0@lo:13: 00002000:00000024:1.0:1788211639.015297:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211639.016114:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660801792:12345-0@lo:13: Request processed in 856us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211639.016125:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788211639.022471:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001364380 x1875075660801792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211639.022555:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660801792:0@lo:13: 00010000:00010000:1.0:1788211639.466267:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211640.485493:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211641.509339:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788211642.162473:0:8457:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc34751d0 20000000:00000080:3.0:1788211642.162496:0:8457:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ac00133b400 uarg=0000000000000000 20000000:01000000:3.0:1788211642.162541:0:8457:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788211642.162544:0:8457:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788211642.162547:0:8457:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788211642.162553:0:8457:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788211642.162564:0:8457:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788211642.162580:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788211642.162583:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788211642.162815:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788211642.162818:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788211642.163890:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788211642.165846:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788211642.165941:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788211642.165980:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788211642.165999:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788211642.166003:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788211642.167349:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788211642.168753:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788211642.168807:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788211642.168857:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788211642.168874:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788211642.168877:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788211642.176230:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788211642.177407:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788211642.177465:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788211642.177508:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788211642.177975:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788211642.177979:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788211642.179313:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788211642.179935:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788211642.180008:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788211642.180046:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1788211642.180067:0:8457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788211642.180094:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180116:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a540b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5404 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180124:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a542e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180131:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfcb37a000/0x2afbce82f55a545f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5458 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180138:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a546d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5466 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180145:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfcb37b400/0x2afbce82f55a547b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5474 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180153:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a5497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5490 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180161:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a54c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a54ba expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180372:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a54cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56de expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180391:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a54d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56e5 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180399:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180447:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a54d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56e5 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180464:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a54d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56e5 expref: 9 pid: 5836 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211642.180483:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660801920:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211642.180656:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a54cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56de expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180666:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a54cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56de expref: 9 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211642.180685:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe093800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802048:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211642.180716:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a54c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a54ba expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180725:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a54c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a54ba expref: 18 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211642.180734:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802176:0@lo:104: 00000100:00100000:2.0:1788211642.180776:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788211642.180822:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a5497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5490 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180830:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a5497 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5490 expref: 18 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211642.180839:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe091c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802304:0@lo:104: 00000100:00100000:2.0:1788211642.180860:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788211642.180877:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfcb37b400/0x2afbce82f55a547b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5474 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180884:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfcb37b400/0x2afbce82f55a547b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5474 expref: 18 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211642.180892:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802432:0@lo:104: 00010000:00010000:2.0:1788211642.180914:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a546d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5466 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180921:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a546d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5466 expref: 18 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211642.180928:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802560:0@lo:104: 00010000:00010000:2.0:1788211642.180945:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfcb37a000/0x2afbce82f55a545f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5458 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180952:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfcb37a000/0x2afbce82f55a545f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5458 expref: 18 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211642.180959:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe091880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802688:0@lo:104: 00010000:00010000:2.0:1788211642.180976:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a542e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.180988:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5435 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a542e expref: 18 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211642.180997:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802816:0@lo:104: 00010000:00010000:2.0:1788211642.181016:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a540b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5404 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.181023:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a540b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5404 expref: 18 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211642.181030:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe092d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802944:0@lo:104: 00000100:00100000:2.0:1788211642.181044:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe1136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211642.181318:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788211642.181340:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211642.181354:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211642.181363:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211642.181370:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211642.181390:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211642.181400:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660802176 00000100:00100000:0.0:1788211642.181408:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660802176 00000100:00100000:0.0:1788211642.181456:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660802304 00000100:00100000:0.0:1788211642.181460:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660802304 00000100:00100000:0.0:1788211642.181470:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660802432 00000100:00100000:0.0:1788211642.181472:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660802432 00000100:00100000:0.0:1788211642.181480:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660802560 00000100:00100000:0.0:1788211642.181483:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660802560 00000100:00100000:0.0:1788211642.181490:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660802688 00000100:00100000:0.0:1788211642.181492:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660802688 00000100:00100000:0.0:1788211642.181499:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660802816 00000100:00100000:0.0:1788211642.181501:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660802816 00000100:00100000:0.0:1788211642.181510:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660802944 00000100:00100000:0.0:1788211642.181512:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660802944 00000100:00100000:0.0:1788211642.181525:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788211642.181534:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe093b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+9:8457:x1875075660802176:12345-0@lo:104: 00010000:00010000:0.0:1788211642.181548:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a54c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.181622:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788211642.181628:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe093b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+9:8457:x1875075660802176:12345-0@lo:104: Request processed in 96us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.181635:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788211642.181653:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788211642.181659:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffe6f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+8:8457:x1875075660802304:12345-0@lo:104: 00010000:00010000:0.0:1788211642.181666:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.181710:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788211642.181715:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffe6f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+8:8457:x1875075660802304:12345-0@lo:104: Request processed in 58us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.181728:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788211642.181761:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788211642.181768:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+7:8457:x1875075660802432:12345-0@lo:104: 00010000:00010000:0.0:1788211642.181775:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a547b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.181802:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788211642.181807:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+7:8457:x1875075660802432:12345-0@lo:104: Request processed in 41us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.181812:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788211642.181823:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788211642.181829:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+6:8457:x1875075660802560:12345-0@lo:104: 00010000:00010000:0.0:1788211642.181836:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a546d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.181860:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788211642.181865:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+6:8457:x1875075660802560:12345-0@lo:104: Request processed in 37us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.181871:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788211642.181882:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788211642.181886:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+5:8457:x1875075660802688:12345-0@lo:104: 00010000:00010000:0.0:1788211642.181892:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a545f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.181916:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788211642.181921:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+5:8457:x1875075660802688:12345-0@lo:104: Request processed in 35us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.181933:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788211642.181946:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788211642.181952:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+4:8457:x1875075660802816:12345-0@lo:104: 00010000:00010000:0.0:1788211642.181959:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5435 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.181986:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788211642.181991:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+4:8457:x1875075660802816:12345-0@lo:104: Request processed in 41us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.181997:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788211642.182008:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788211642.182013:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+3:8457:x1875075660802944:12345-0@lo:104: 00010000:00010000:0.0:1788211642.182019:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a540b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182043:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788211642.182048:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+3:8457:x1875075660802944:12345-0@lo:104: Request processed in 36us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.182053:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788211642.182074:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788211642.182080:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a54c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182088:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4800 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211642.182092:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a54c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182112:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a54c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211642.182120:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a54c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211642.182126:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788211642.182192:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a54c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182199:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211642.182219:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a54c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182227:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4800/0x2afbce82f55a54ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a54c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182241:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788211642.182244:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182249:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211642.182253:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a5497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182259:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a5497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211642.182265:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a5497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211642.182277:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788211642.182291:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182297:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211642.182313:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182320:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a5490 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5497 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182330:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788211642.182333:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a547b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182339:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37aa00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211642.182341:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a547b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182348:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a547b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211642.182353:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a547b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211642.182358:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788211642.182371:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a547b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182375:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211642.182388:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a547b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182393:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a5474 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a547b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182401:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788211642.182403:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a546d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182408:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0031e00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211642.182411:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a546d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182416:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a546d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211642.182422:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a546d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211642.182427:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788211642.182438:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a546d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182443:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211642.182447:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a546d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182453:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a5466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a546d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182462:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788211642.182470:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a545f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182476:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c5600 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211642.182479:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a545f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182485:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a545f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211642.182490:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a545f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211642.182495:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788211642.182507:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a545f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182513:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211642.182517:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a545f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182523:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a5458 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a545f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182532:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788211642.182535:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5435 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182541:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030e00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211642.182544:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a5435 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182562:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a5435 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211642.182567:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a5435 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211642.182572:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788211642.182583:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5435 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182589:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211642.182593:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5435 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182599:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a542e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5435 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182607:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211642.182610:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a540b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182615:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0031600 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211642.182618:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a540b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182624:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a540b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211642.182630:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a540b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211642.182640:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788211642.182650:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a540b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182655:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211642.182659:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a540b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182665:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc0031600/0x2afbce82f55a5404 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a540b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.182692:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211642.182694:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211642.182696:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211642.182704:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211642.182718:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660803072:0@lo:103: 00000100:00100000:0.0:1788211642.182761:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211642.182794:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660803584:0@lo:103: 00000100:00100000:0.0:1788211642.182826:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211642.182850:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788211642.182855:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660803456:0@lo:103: 00000100:00100000:0.0:1788211642.182874:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211642.182900:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660803200:0@lo:103: 00000100:00100000:0.0:1788211642.182921:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211642.182931:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660803712:0@lo:103: 00000100:00100000:0.0:1788211642.182947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211642.182967:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788211642.182972:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660803328:0@lo:103: 00000100:00100000:0.0:1788211642.182991:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211642.183000:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660803840:0@lo:103: 00000100:00100000:0.0:1788211642.183020:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211642.183046:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660803072 00000100:00100000:0.0:1788211642.183053:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660803072 00010000:00010000:0.0:1788211642.183079:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a54c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a54ba expref: 19 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211642.183097:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660803584 00000100:00100000:0.0:1788211642.183100:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660803584 00010000:00010000:0.0:1788211642.183109:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfcb37a000/0x2afbce82f55a545f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5458 expref: 20 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211642.183119:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660803456 00000100:00100000:0.0:1788211642.183121:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660803456 00010000:00010000:0.0:1788211642.183130:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a546d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5466 expref: 21 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211642.183139:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660803200 00000100:00100000:0.0:1788211642.183141:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660803200 00010000:00010000:0.0:1788211642.183152:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a5497 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5490 expref: 22 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211642.183161:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660803712 00000100:00100000:0.0:1788211642.183163:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660803712 00010000:00010000:0.0:1788211642.183196:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5435 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a542e expref: 23 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211642.183207:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660803328 00000100:00100000:0.0:1788211642.183210:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660803328 00010000:00010000:0.0:1788211642.183227:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfcb37b400/0x2afbce82f55a547b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5474 expref: 24 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211642.183238:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660803840 00000100:00100000:0.0:1788211642.183241:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660803840 00010000:00010000:0.0:1788211642.183249:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a540b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5404 expref: 25 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211642.183260:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788211642.183268:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+25:3309:x1875075660803072:12345-0@lo:103: 00010000:00010000:0.0:1788211642.183278:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211642.183285:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a54c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a54ba expref: 25 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183296:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a54c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a54ba expref: 25 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183319:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211642.183353:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+25:3309:x1875075660803072:12345-0@lo:103: Request processed in 86us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.183360:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788211642.183378:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788211642.183384:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+24:3309:x1875075660803584:12345-0@lo:103: 00010000:00010000:0.0:1788211642.183392:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211642.183396:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfcb37a000/0x2afbce82f55a545f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5458 expref: 24 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183404:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfcb37a000/0x2afbce82f55a545f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5458 expref: 24 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183424:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211642.183446:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+24:3309:x1875075660803584:12345-0@lo:103: Request processed in 63us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.183453:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788211642.183466:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788211642.183472:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+23:3309:x1875075660803456:12345-0@lo:103: 00010000:00010000:0.0:1788211642.183478:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211642.183482:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a546d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5466 expref: 23 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183490:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a546d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5466 expref: 23 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183499:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211642.183518:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+23:3309:x1875075660803456:12345-0@lo:103: Request processed in 48us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.183524:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788211642.183535:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788211642.183540:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe289f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+22:3310:x1875075660803200:12345-0@lo:103: 00010000:00010000:0.0:1788211642.183549:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211642.183553:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a5497 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5490 expref: 22 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183560:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a5497 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5490 expref: 22 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183569:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211642.183600:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe289f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+22:3310:x1875075660803200:12345-0@lo:103: Request processed in 60us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.183606:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788211642.183618:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788211642.183624:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+21:3310:x1875075660803712:12345-0@lo:103: 00010000:00010000:0.0:1788211642.183632:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211642.183636:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5435 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a542e expref: 21 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183644:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5435 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a542e expref: 21 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183654:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211642.183692:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+21:3310:x1875075660803712:12345-0@lo:103: Request processed in 68us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.183698:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788211642.183709:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788211642.183714:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe289180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+20:3310:x1875075660803328:12345-0@lo:103: 00010000:00010000:0.0:1788211642.183722:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211642.183726:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfcb37b400/0x2afbce82f55a547b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5474 expref: 20 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183734:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfcb37b400/0x2afbce82f55a547b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5474 expref: 20 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183742:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211642.183762:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe289180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+20:3310:x1875075660803328:12345-0@lo:103: Request processed in 48us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.183769:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788211642.183788:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788211642.183794:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660803840:12345-0@lo:103: 00010000:00010000:0.0:1788211642.183802:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211642.183806:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a540b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5404 expref: 19 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183814:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a540b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5404 expref: 19 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.183823:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211642.183845:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660803840:12345-0@lo:103: Request processed in 52us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211642.183851:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788211642.183915:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660803328:0@lo:103: 00000100:00100000:0.0:1788211642.183925:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660803840:0@lo:103: 00000100:00100000:0.0:1788211642.183932:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660803200:0@lo:103: 00000100:00100000:0.0:1788211642.183938:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660803712:0@lo:103: 00000100:00100000:0.0:1788211642.183967:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660803456:0@lo:103: 00000100:00100000:0.0:1788211642.183975:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660803072:0@lo:103: 00000100:00100000:0.0:1788211642.183981:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660803584:0@lo:103: 00010000:00010000:3.0:1788211642.184151:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a54c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a54ba expref: 18 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211642.184188:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802176:0@lo:104: 00010000:00010000:3.0:1788211642.184201:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a5497 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5490 expref: 17 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211642.184209:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe091c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802304:0@lo:104: 00010000:00010000:3.0:1788211642.184218:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37b400/0x2afbce82f55a547b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5474 expref: 16 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211642.184226:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802432:0@lo:104: 00010000:00010000:3.0:1788211642.184235:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a546d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5466 expref: 15 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211642.184243:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802560:0@lo:104: 00010000:00010000:3.0:1788211642.184252:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37a000/0x2afbce82f55a545f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5458 expref: 14 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211642.184274:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe091880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802688:0@lo:104: 00010000:00010000:3.0:1788211642.184289:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5435 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a542e expref: 13 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211642.184298:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802816:0@lo:104: 00010000:00010000:3.0:1788211642.184307:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a540b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5404 expref: 12 pid: 5838 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211642.184315:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe092d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802944:0@lo:104: 00000100:00100000:1.0:1788211642.190515:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211642.190572:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211642.190871:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637710848 00000100:00100000:3.0:1788211642.190883:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637710848 00010000:00010000:3.0:1788211642.190933:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a54d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56e5 expref: 10 pid: 5836 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211642.190976:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637710976 00000100:00100000:3.0:1788211642.190980:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637710976 00010000:00010000:3.0:1788211642.190994:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a54cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56de expref: 11 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211642.191011:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:3.0:1788211642.191020:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:2358:x1875075637710848:12345-192.168.204.29@tcp:103: 00010000:00010000:3.0:1788211642.191038:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211642.191043:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a54d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56e5 expref: 11 pid: 5836 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191056:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a54d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56e5 expref: 11 pid: 5836 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191105:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211642.191210:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:2358:x1875075637710848:12345-192.168.204.29@tcp:103: Request processed in 189us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211642.191218:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:3.0:1788211642.191237:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:3.0:1788211642.191244:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2358:x1875075637710976:12345-192.168.204.29@tcp:103: 00010000:00010000:3.0:1788211642.191252:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211642.191256:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a54cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56de expref: 10 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191265:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a54cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56de expref: 10 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191277:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191286:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191301:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191308:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191315:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191322:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191334:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211642.191340:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191349:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191358:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211642.191371:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211642.191392:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2358:x1875075637710976:12345-192.168.204.29@tcp:103: Request processed in 149us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211642.191399:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00010000:00010000:2.0:1788211642.193321:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a54d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56e5 expref: 9 pid: 5836 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211642.193353:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660801920:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211642.193367:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c5a00/0x2afbce82f55a54cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f56de expref: 8 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211642.193378:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe093800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1875075660802048:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211642.193444:0:8457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.193456:0:8457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.193463:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211642.193491:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a550e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211642.533373:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211643.099791:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211643.099859:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211643.099901:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211643.099931:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211643.099959:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637711104 00000100:00100000:1.0:1788211643.099969:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637711104 00000100:00100000:1.0:1788211643.100020:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 130 00000100:00100000:1.0:1788211643.100030:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+8:2361:x1875075637711104:12345-192.168.204.29@tcp:400: 00000100:00100000:1.0:1788211643.100114:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+8:2361:x1875075637711104:12345-192.168.204.29@tcp:400: Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211643.100122:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 130 00000100:00100000:0.0:1788211643.100795:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637711232 00000100:00100000:0.0:1788211643.100804:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637711232 00000100:00100000:0.0:1788211643.100874:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:0.0:1788211643.100882:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637711232:12345-192.168.204.29@tcp:400: 00000100:00100000:0.0:1788211643.100949:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637711232:12345-192.168.204.29@tcp:400: Request processed in 67us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211643.100957:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:0.0:1788211643.100982:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637711488 00000100:00100000:0.0:1788211643.100986:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637711488 00000100:00100000:0.0:1788211643.101014:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637711360 00000100:00100000:0.0:1788211643.101017:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637711360 00000100:00100000:0.0:1788211643.101037:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:0.0:1788211643.101044:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637711488:12345-192.168.204.29@tcp:400: 00000100:00100000:0.0:1788211643.101094:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637711488:12345-192.168.204.29@tcp:400: Request processed in 50us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211643.101101:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:0.0:1788211643.101114:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:0.0:1788211643.101120:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637711360:12345-192.168.204.29@tcp:400: 00000100:00100000:0.0:1788211643.101143:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637711360:12345-192.168.204.29@tcp:400: Request processed in 24us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211643.101148:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00080000:1.0:1788211643.103481:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788211643.103496:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211643.103499:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211643.110918:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788211643.110960:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660803968:0@lo:13: 00000100:00100000:2.0:1788211643.111228:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211643.112682:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660803968 00000100:00100000:1.0:1788211643.112701:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660803968 00000100:00100000:1.0:1788211643.112808:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788211643.112820:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660803968:12345-0@lo:13: 00002000:00000024:1.0:1788211643.112865:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211643.112975:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660803968:12345-0@lo:13: Request processed in 156us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211643.112984:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788211643.113735:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abff6463b80 x1875075660803968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211643.113770:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660803968:0@lo:13: 00000100:00080000:2.0:1788211643.114226:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788211643.561598:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211643.622828:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660804352:0@lo:400: 00000100:00100000:0.0:1788211643.622926:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660804224:0@lo:400: 00000100:00100000:1.0:1788211643.622930:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211643.622992:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660804480:0@lo:400: 00000100:00100000:3.0:1788211643.623068:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660804096:0@lo:400: 00000100:00100000:0.0:1788211643.623921:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211643.624103:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660804352 00000100:00100000:0.0:1788211643.624113:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660804352 00000100:00100000:0.0:1788211643.624220:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660804224 00000100:00100000:0.0:1788211643.624225:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660804224 00000100:00100000:0.0:1788211643.624252:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788211643.624265:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660804352:12345-0@lo:400: 00000100:00100000:0.0:1788211643.624488:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660804352:12345-0@lo:400: Request processed in 225us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211643.624496:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788211643.624516:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788211643.624523:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660804224:12345-0@lo:400: 00000100:00100000:0.0:1788211643.624558:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660804224:12345-0@lo:400: Request processed in 36us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211643.624565:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788211643.624590:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211643.624629:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660804224:0@lo:400: 00000100:00100000:3.0:1788211643.625803:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211643.625870:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660804608:0@lo:400: 00000100:00100000:3.0:1788211643.625917:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211643.626159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211643.626911:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660804352:0@lo:400: 00000100:00100000:0.0:1788211643.627244:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660804096 00000100:00100000:0.0:1788211643.627253:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660804096 00000100:00100000:0.0:1788211643.627408:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788211643.627419:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc923bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:3309:x1875075660804096:12345-0@lo:400: 00000100:00100000:0.0:1788211643.627503:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc923bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+12:3309:x1875075660804096:12345-0@lo:400: Request processed in 86us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211643.627512:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788211643.627542:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660804608 00000100:00100000:0.0:1788211643.627545:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660804608 00000100:00100000:0.0:1788211643.627582:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788211643.627588:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660804608:12345-0@lo:400: 00000100:00100000:0.0:1788211643.627620:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660804608:12345-0@lo:400: Request processed in 32us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211643.627626:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788211643.627655:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788211643.627726:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660804480 00000100:00100000:3.0:1788211643.627732:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660804480 00000100:00100000:3.0:1788211643.627778:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788211643.627786:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660804480:12345-0@lo:400: 00000100:00100000:3.0:1788211643.627832:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660804480:12345-0@lo:400: Request processed in 48us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211643.627859:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788211643.628493:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660804480:0@lo:400: 00000100:00100000:1.0:1788211643.628502:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660804096:0@lo:400: 00010000:00080000:1.0:1788211643.628518:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe289180 x1875075660804608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211643.628538:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660804608:0@lo:400: 00000100:00080000:0.0:1788211643.628571:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1788211644.005402:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788211644.005412:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8abfcaf32000 from 39 10000000:01000000:1.0:1788211644.005418:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788211644.005491:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.005517:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.005533:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211644.005567:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660804736:0@lo:101: 00000100:00100000:1.0:1788211644.005968:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211644.006222:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf68180 going to sleep for 11 seconds 00000100:00100000:3.0:1788211644.006404:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660804736 00000100:00100000:3.0:1788211644.006416:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660804736 00000100:00100000:3.0:1788211644.006482:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788211644.006500:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc923b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+12:5840:x1875075660804736:12345-0@lo:101: 00010000:00010000:3.0:1788211644.006518:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211644.006539:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a551c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5515 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211644.006571:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a551c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5515 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211644.006583:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a551c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5515 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211644.006594:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062e00, rc 0) 00000100:00100000:3.0:1788211644.006872:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc923b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660804736:12345-0@lo:101: Request processed in 380us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211644.006885:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788211644.007194:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660804736:0@lo:101: 00010000:00010000:1.0:1788211644.007212:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.007223:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211644.007814:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660804864:0@lo:501: 00000100:00100000:1.0:1788211644.007858:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211644.007954:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf68180 going to sleep for 11 seconds 00000100:00100000:2.0:1788211644.018058:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660804864 00000100:00100000:2.0:1788211644.018081:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660804864 00000100:00100000:2.0:1788211644.018207:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788211644.018678:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660804864:12345-0@lo:501: 00000100:00100000:2.0:1788211644.019324:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660804864:12345-0@lo:501: Request processed in 1105us (11463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.019335:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788211644.026120:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660804864:0@lo:501: 00000100:00100000:1.0:1788211644.026591:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660804992:0@lo:503: 00000100:00100000:1.0:1788211644.026767:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211644.026821:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf68180 going to sleep for 11 seconds 00000100:00100000:3.0:1788211644.027224:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660804992 00000100:00100000:3.0:1788211644.027234:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660804992 00000100:00100000:3.0:1788211644.027979:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788211644.027996:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660804992:12345-0@lo:503: 00000100:00100000:1.0:1788211644.033334:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660804992:0@lo:503: 00000100:00100000:3.0:1788211644.033480:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660804992:12345-0@lo:503: Request processed in 5488us (6711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211644.034101:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788211644.036654:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8474:1875075660805120:0@lo:502: 00000100:00100000:1.0:1788211644.036760:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211644.036810:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211644.036889:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660805120 00000100:00100000:2.0:1788211644.036898:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660805120 00000100:00100000:2.0:1788211644.036950:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788211644.036960:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:8474:x1875075660805120:12345-0@lo:502: 00000100:00100000:2.0:1788211644.037275:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+13:8474:x1875075660805120:12345-0@lo:502: Request processed in 316us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.037283:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788211644.041584:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8474:1875075660805120:0@lo:502: 00000100:00100000:1.0:1788211644.041705:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8474:1875075660805248:0@lo:502: 00000100:00100000:1.0:1788211644.041783:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211644.041835:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211644.041857:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660805248 00000100:00100000:3.0:1788211644.041867:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660805248 00000100:00100000:3.0:1788211644.041938:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788211644.041947:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+13:8474:x1875075660805248:12345-0@lo:502: 00000100:00100000:3.0:1788211644.042276:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+13:8474:x1875075660805248:12345-0@lo:502: Request processed in 329us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211644.042283:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788211644.042390:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8474:1875075660805248:0@lo:502: 00000040:00080000:1.0:1788211644.042418:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788211644.042846:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788211644.042867:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788211644.042890:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.042902:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211644.042912:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788211644.042915:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788211644.042918:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788211644.042952:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.042960:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.042969:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211644.042984:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660805376:0@lo:101: 00000100:00100000:2.0:1788211644.043024:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211644.043116:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113780 going to sleep for 11 seconds 00000100:00100000:0.0:1788211644.043155:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660805376 00000100:00100000:0.0:1788211644.043161:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660805376 00000100:00100000:0.0:1788211644.043223:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788211644.043232:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+13:5840:x1875075660805376:12345-0@lo:101: 00010000:00010000:0.0:1788211644.043244:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211644.043258:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0031600/0x2afbce82f55a552a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5523 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211644.043282:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0031600/0x2afbce82f55a552a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5523 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211644.043293:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0031600/0x2afbce82f55a552a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5523 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211644.043302:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0031600, rc 0) 00000100:00100000:0.0:1788211644.043530:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660805376:12345-0@lo:101: Request processed in 297us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211644.043536:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788211644.048213:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660805376:0@lo:101: 00010000:00010000:1.0:1788211644.048246:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.048259:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211644.048973:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660805504:0@lo:501: 00000100:00100000:0.0:1788211644.051520:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211644.051588:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd878a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788211644.051725:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660805504 00000100:00100000:1.0:1788211644.051734:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660805504 00000100:00100000:1.0:1788211644.051787:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788211644.051797:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660805504:12345-0@lo:501: 00000100:00100000:1.0:1788211644.052106:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660805504:12345-0@lo:501: Request processed in 310us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211644.052133:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788211644.052842:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660805504:0@lo:501: 00000100:00100000:0.0:1788211644.052900:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660805632:0@lo:503: 00000100:00100000:0.0:1788211644.052952:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211644.052990:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd878a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788211644.053045:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660805632 00000100:00100000:1.0:1788211644.053051:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660805632 00000100:00100000:1.0:1788211644.053094:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788211644.053103:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660805632:12345-0@lo:503: 00000100:00100000:0.0:1788211644.053705:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660805632:12345-0@lo:503: Request processed in 600us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211644.053715:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788211644.053820:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660805632:0@lo:503: 00000100:00100000:2.0:1788211644.054217:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8475:1875075660805760:0@lo:502: 00000100:00100000:2.0:1788211644.054260:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211644.054525:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211644.054584:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660805760 00000100:00100000:3.0:1788211644.054590:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660805760 00000100:00100000:3.0:1788211644.054629:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788211644.054647:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+14:8475:x1875075660805760:12345-0@lo:502: 00000100:00100000:3.0:1788211644.054833:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+14:8475:x1875075660805760:12345-0@lo:502: Request processed in 187us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211644.054841:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788211644.054940:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8475:1875075660805760:0@lo:502: 00000020:01000000:0.0:1788211644.054969:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211644.054978:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211644.054981:0:8475:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788211644.054987:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788211644.055010:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8475:1875075660805888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211644.055048:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211644.055073:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd878a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788211644.055240:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660805888 00000100:00100000:1.0:1788211644.055245:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660805888 00000100:00100000:1.0:1788211644.055287:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788211644.055295:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:8475:x1875075660805888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788211644.055607:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+14:8475:x1875075660805888:12345-0@lo:502:llog_process_th.0 Request processed in 312us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211644.055615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788211644.055708:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8475:1875075660805888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788211644.055730:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211644.055735:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211644.055737:0:8475:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788211644.055741:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788211644.056045:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788211644.056067:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788211644.056077:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.056087:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211644.056096:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788211644.056099:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ac001fd6800 from 39 10000000:01000000:1.0:1788211644.056101:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788211644.056143:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.056151:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.056208:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211644.056227:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660806016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788211644.056516:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211644.056554:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf68d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788211644.056611:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660806016 00000100:00100000:3.0:1788211644.056618:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660806016 00000100:00100000:3.0:1788211644.056672:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788211644.056682:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+14:5840:x1875075660806016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788211644.056694:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211644.056711:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6063e00/0x2afbce82f55a5538 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5531 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211644.056738:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6063e00/0x2afbce82f55a5538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5531 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211644.056749:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6063e00/0x2afbce82f55a5538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5531 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211644.056759:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063e00, rc 0) 00000100:00100000:3.0:1788211644.056805:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660806016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211644.056821:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788211644.057452:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660806016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211644.057476:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211644.057488:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211644.057579:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660806144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211644.057620:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211644.057660:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd878a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788211644.058139:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660806144 00000100:00100000:3.0:1788211644.058146:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660806144 00000100:00100000:3.0:1788211644.058225:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788211644.058235:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660806144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211644.058767:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660806144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 531us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211644.058776:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788211644.059310:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660806144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211644.059490:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660806272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211644.059551:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211644.059709:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd878a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788211644.059906:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660806272 00000100:00100000:2.0:1788211644.059914:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660806272 00000100:00100000:2.0:1788211644.059964:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788211644.059975:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660806272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211644.061522:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660806272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1542us (1964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.061536:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788211644.063998:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660806272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788211644.071779:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8476:1875075660806400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211644.071895:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211644.071943:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca8e2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788211644.072089:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660806400 00000100:00100000:2.0:1788211644.072099:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660806400 00000100:00100000:2.0:1788211644.072157:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788211644.072199:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:8476:x1875075660806400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211644.072514:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+15:8476:x1875075660806400:12345-0@lo:502:llog_process_th.0 Request processed in 346us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.072522:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788211644.072801:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8476:1875075660806400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788211644.072871:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8476:1875075660806528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788211644.072921:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211644.072956:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf68d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788211644.073019:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660806528 00000100:00100000:0.0:1788211644.073024:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660806528 00000100:00100000:0.0:1788211644.073059:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788211644.073067:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:8476:x1875075660806528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211644.073253:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:8476:x1875075660806528:12345-0@lo:502:llog_process_th.0 Request processed in 187us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211644.073270:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788211644.073482:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8476:1875075660806528:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788211644.073510:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788211644.073884:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788211644.073900:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788211644.073910:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211644.073921:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211644.073931:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788211644.073934:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788211644.073936:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788211644.073961:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211644.073968:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211644.073978:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211644.073995:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660806656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788211644.074737:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211644.074781:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd878a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211644.075617:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660806656 00000100:00100000:2.0:1788211644.075644:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660806656 00000100:00100000:2.0:1788211644.075705:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788211644.075716:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+15:5840:x1875075660806656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788211644.075734:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211644.075751:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a5546 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a553f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.075776:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a5546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a553f expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.075788:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a5546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a553f expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.075799:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80000, rc 0) 00000100:00100000:2.0:1788211644.075911:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660806656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.075935:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788211644.080249:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660806656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211644.080493:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211644.080507:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211644.080613:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660806784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211644.080688:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211644.080734:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd878a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211644.080799:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660806784 00000100:00100000:3.0:1788211644.080806:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660806784 00000100:00100000:3.0:1788211644.080857:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788211644.080867:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660806784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211644.081200:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660806784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211644.081210:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788211644.081771:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660806784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211644.081808:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660806912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211644.081858:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211644.081891:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd878a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211644.082153:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660806912 00000100:00100000:3.0:1788211644.082158:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660806912 00000100:00100000:3.0:1788211644.082538:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788211644.082547:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660806912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788211644.082892:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660806912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 346us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211644.082901:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788211644.083039:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660806912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211644.087368:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe091880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8477:1875075660807040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211644.087532:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211644.087580:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113540 going to sleep for 11 seconds 00000100:00100000:0.0:1788211644.088911:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660807040 00000100:00100000:0.0:1788211644.088924:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660807040 00000100:00100000:0.0:1788211644.088989:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788211644.089000:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+16:8477:x1875075660807040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211644.089323:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+16:8477:x1875075660807040:12345-0@lo:502:llog_process_th.0 Request processed in 323us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211644.089332:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788211644.089477:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe091880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8477:1875075660807040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788211644.089519:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211644.089530:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211644.089534:0:8477:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788211644.089540:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788211644.089576:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe091880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8477:1875075660807168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211644.089621:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211644.089668:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113540 going to sleep for 11 seconds 00000100:00100000:3.0:1788211644.089810:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660807168 00000100:00100000:3.0:1788211644.089815:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660807168 00000100:00100000:3.0:1788211644.089893:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788211644.089902:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+16:8477:x1875075660807168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211644.090077:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+16:8477:x1875075660807168:12345-0@lo:502:llog_process_th.0 Request processed in 176us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211644.090083:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788211644.090136:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe091880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8477:1875075660807168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788211644.090160:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211644.090197:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211644.090200:0:8477:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788211644.090204:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788211644.090684:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788211644.090710:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788211644.090721:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211644.090732:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211644.090743:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788211644.090746:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8abfc288e800 from 39 10000000:01000000:0.0:1788211644.090749:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788211644.090776:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211644.090784:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211644.090793:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211644.090812:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660807296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788211644.090852:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211644.090893:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd878a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788211644.092933:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660807296 00000100:00100000:2.0:1788211644.092948:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660807296 00000100:00100000:2.0:1788211644.093023:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788211644.093034:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660807296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788211644.093061:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211644.093080:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a5554 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a554d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.093112:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a5554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a554d expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.093124:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a5554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a554d expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.093135:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81a00, rc 0) 00000100:00100000:2.0:1788211644.093283:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660807296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.093291:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788211644.093502:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660807296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211644.093521:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211644.093532:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211644.093603:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660807424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211644.093657:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211644.093702:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd878a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788211644.093840:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660807424 00000100:00100000:2.0:1788211644.093845:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660807424 00000100:00100000:2.0:1788211644.093879:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788211644.093886:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660807424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211644.094791:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660807424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 897us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.094803:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788211644.100445:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe289500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660807424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211644.101700:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660807552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788211644.101797:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211644.102268:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca8e2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788211644.107277:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660807552 00000100:00100000:0.0:1788211644.107296:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660807552 00000100:00100000:0.0:1788211644.107440:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788211644.107453:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660807552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211644.107761:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660807552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 311us (5964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211644.107770:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788211644.107848:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660807552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788211644.113375:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8478:1875075660807680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211644.114564:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211644.114648:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca8e2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788211644.115113:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660807680 00000100:00100000:2.0:1788211644.115127:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660807680 00000100:00100000:2.0:1788211644.115218:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788211644.115229:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:8478:x1875075660807680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211644.116139:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:8478:x1875075660807680:12345-0@lo:502:llog_process_th.0 Request processed in 909us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.116150:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788211644.119617:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8478:1875075660807680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211644.119724:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8478:1875075660807808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211644.119806:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211644.119857:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca8e2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788211644.119933:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660807808 00000100:00100000:0.0:1788211644.119941:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660807808 00000100:00100000:0.0:1788211644.120006:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788211644.120017:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:8478:x1875075660807808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211644.120429:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:8478:x1875075660807808:12345-0@lo:502:llog_process_th.0 Request processed in 413us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211644.120438:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788211644.124348:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8478:1875075660807808:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788211644.124404:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788211644.124605:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788211644.124645:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788211644.124657:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.124689:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211644.124700:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788211644.124702:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788211644.124705:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788211644.124739:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.124746:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.124755:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211644.124774:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660807936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788211644.124836:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211644.124876:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8449b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211644.124890:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660807936 00000100:00100000:2.0:1788211644.124898:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660807936 00000100:00100000:2.0:1788211644.125029:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788211644.125101:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660807936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788211644.125115:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211644.125129:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abffdb81e00/0x2afbce82f55a5562 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a555b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.125211:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb81e00/0x2afbce82f55a5562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a555b expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.125222:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abffdb81e00/0x2afbce82f55a5562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a555b expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.125230:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81e00, rc 0) 00000100:00100000:2.0:1788211644.125282:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660807936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211644.125350:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660807936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788211644.125365:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211644.125377:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211644.125428:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660808064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211644.125468:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211644.125490:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660808064 00000100:00100000:3.0:1788211644.125493:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660808064 00000100:00100000:2.0:1788211644.128125:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788211644.128356:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca8e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788211644.129146:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788211644.129180:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660808064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211644.129546:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660808064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 388us (4076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211644.129554:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788211644.129765:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660808064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211644.129820:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660808192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788211644.129880:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211644.129907:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8449b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211644.130147:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660808192 00000100:00100000:2.0:1788211644.130154:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660808192 00000100:00100000:2.0:1788211644.130221:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788211644.130233:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660808192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211644.130403:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660808192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.130410:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788211644.130459:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660808192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211644.130848:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8479:1875075660808320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211644.130899:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211644.131092:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd878a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211644.131700:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660808320 00000100:00100000:2.0:1788211644.131709:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660808320 00000100:00100000:2.0:1788211644.131799:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788211644.132973:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:8479:x1875075660808320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211644.133351:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:8479:x1875075660808320:12345-0@lo:502:llog_process_th.0 Request processed in 395us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.133361:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788211644.133373:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660808448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211644.133845:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211644.134101:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660808448 00000100:00100000:1.0:1788211644.134109:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660808448 00000100:00100000:1.0:1788211644.134161:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788211644.134190:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660808448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788211644.134232:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211644.134278:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660808448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211644.134285:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788211644.134383:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001367480 x1875075660808448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211644.134404:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660808448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788211644.137250:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8479:1875075660808320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788211644.137302:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211644.137312:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211644.137315:0:8479:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788211644.137320:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788211644.137361:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8479:1875075660808576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211644.137652:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211644.137699:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd878a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211644.137952:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660808576 00000100:00100000:1.0:1788211644.137961:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660808576 00000100:00100000:1.0:1788211644.138089:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788211644.138099:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:8479:x1875075660808576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788211644.142772:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:8479:x1875075660808576:12345-0@lo:502:llog_process_th.0 Request processed in 4663us (5108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211644.142789:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788211644.144206:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8479:1875075660808576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788211644.144829:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211644.144840:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211644.144842:0:8479:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788211644.144848:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788211644.145403:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788211644.145422:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788211644.145432:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.145444:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211644.145455:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788211644.145458:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8abfca8a4d28 from 1 10000000:01000000:1.0:1788211644.145460:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788211644.145494:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07e00/0x2afbce82f55a5569 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.145516:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07e00/0x2afbce82f55a5569 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.145528:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07e00/0x2afbce82f55a5569 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211644.145555:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660808704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788211644.145626:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211644.145681:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788211644.145714:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660808704 00000100:00100000:3.0:1788211644.145723:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660808704 00000100:00100000:3.0:1788211644.145780:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788211644.145809:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660808704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788211644.145824:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211644.145841:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5570 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5569 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211644.145872:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5569 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211644.145883:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5569 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211644.145906:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062a00, rc 0) 00000100:00100000:3.0:1788211644.145957:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660808704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211644.145965:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788211644.146355:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660808704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211644.146371:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07e00/0x2afbce82f55a5569 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5570 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.146381:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07e00/0x2afbce82f55a5569 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5570 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211644.146436:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660808832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211644.146468:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211644.146494:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660808832 00000100:00100000:1.0:1788211644.146497:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660808832 00000100:00100000:1.0:1788211644.146521:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788211644.146528:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660808832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211644.146801:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660808832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (331us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788211644.146809:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788211644.146840:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788211644.146856:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660808832:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788211644.146892:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788211644.146899:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07e00/0x2afbce82f55a5569 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5570 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.146907:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07e00/0x2afbce82f55a5569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5570 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211644.511659:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211644.517121:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637711616 00000100:00100000:2.0:1788211644.517138:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637711616 00000100:00100000:2.0:1788211644.518099:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 164 00000100:00100000:2.0:1788211644.518113:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+8:5602:x1875075637711616:12345-192.168.204.29@tcp:101: 00010000:00010000:2.0:1788211644.518131:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211644.518153:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a5577 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5747 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.518220:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a5577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5747 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.518242:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a5577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5747 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211644.518253:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80e00, rc 0) 00000100:00100000:2.0:1788211644.518349:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:5602:x1875075637711616:12345-192.168.204.29@tcp:101: Request processed in 239us (6704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.518356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 164 00000100:00100000:3.0:1788211644.522345:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211644.522728:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637711744 00000100:00100000:0.0:1788211644.522739:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637711744 00000100:00100000:0.0:1788211644.522789:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 165 00000100:00100000:0.0:1788211644.522800:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:5602:x1875075637711744:12345-192.168.204.29@tcp:501: 00000100:00100000:0.0:1788211644.523683:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:5602:x1875075637711744:12345-192.168.204.29@tcp:501: Request processed in 876us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211644.523694:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 165 00000100:00100000:3.0:1788211644.530724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211644.531077:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637711872 00000100:00100000:0.0:1788211644.531093:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637711872 00000100:00100000:0.0:1788211644.531277:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 166 00000100:00100000:0.0:1788211644.531292:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:5602:x1875075637711872:12345-192.168.204.29@tcp:503: 00000100:00100000:0.0:1788211644.531973:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:5602:x1875075637711872:12345-192.168.204.29@tcp:503: Request processed in 678us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211644.531985:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 166 00000100:00100000:3.0:1788211644.537972:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211644.538128:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637712000 00000100:00100000:2.0:1788211644.538141:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637712000 00000100:00100000:2.0:1788211644.538247:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 167 00000100:00100000:2.0:1788211644.538259:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:6081:x1875075637712000:12345-192.168.204.29@tcp:502: 00000100:00100000:2.0:1788211644.538630:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:6081:x1875075637712000:12345-192.168.204.29@tcp:502: Request processed in 363us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.538638:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 167 00000100:00100000:3.0:1788211644.545348:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211644.546022:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637712128 00000100:00100000:2.0:1788211644.546036:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637712128 00000100:00100000:2.0:1788211644.546107:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 168 00000100:00100000:2.0:1788211644.546117:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:6081:x1875075637712128:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788211644.546804:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:6081:x1875075637712128:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 685us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211644.546814:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 168 00000100:00100000:3.0:1788211644.554695:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211644.555767:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637712256 00000100:00100000:1.0:1788211644.555795:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637712256 00000100:00100000:1.0:1788211644.555889:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 169 00000100:00100000:1.0:1788211644.555902:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:5602:x1875075637712256:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211644.555921:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211644.555946:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b06e00/0x2afbce82f55a557e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f574e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.555983:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b06e00/0x2afbce82f55a557e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f574e expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.555996:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b06e00/0x2afbce82f55a557e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f574e expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211644.556008:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06e00, rc 0) 00000100:00100000:1.0:1788211644.556575:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5602:x1875075637712256:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 673us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211644.556588:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 169 00000100:00100000:3.0:1788211644.562587:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211644.562799:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637712384 00000100:00100000:2.0:1788211644.562812:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637712384 00000100:00100000:2.0:1788211644.563601:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 170 00000100:00100000:2.0:1788211644.563616:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5602:x1875075637712384:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211644.568157:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5602:x1875075637712384:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 4534us (7099us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788211644.568201:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 170 00010000:00010000:0.0:1788211644.582852:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211645.605864:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788211646.499087:0:8516:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee726d8e0 20000000:00000080:3.0:1788211646.499109:0:8516:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8abfcacf9c00 uarg=0000000000000000 20000000:01000000:3.0:1788211646.499149:0:8516:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788211646.499156:0:8516:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788211646.499161:0:8516:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788211646.500394:0:8517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788211646.500673:0:8516:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788211646.506832:0:8516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788211646.506911:0:8516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788211646.506972:0:8516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788211646.506997:0:8516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788211646.507034:0:8516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211646.507059:0:8516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc13c5c00/0x2afbce82f55a52fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a52f3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211646.507068:0:8516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc13c4400/0x2afbce82f55a535c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5355 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211646.507094:0:8516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abec6062600/0x2afbce82f55a5427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5420 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211646.507105:0:8516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfcb37a800/0x2afbce82f55a54e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5716 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211646.507113:0:8516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211646.507472:0:8516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfcb37a800/0x2afbce82f55a54e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5716 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211646.507499:0:8516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfcb37a800/0x2afbce82f55a54e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5716 expref: 9 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211646.507519:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1875075660808960:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211646.507739:0:8516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abec6062600/0x2afbce82f55a5427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5420 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211646.508052:0:8516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abec6062600/0x2afbce82f55a5427 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5420 expref: 18 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211646.508063:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1875075660809088:0@lo:104: 00000100:00100000:3.0:1788211646.508106:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788211646.508217:0:8516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc13c4400/0x2afbce82f55a535c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5355 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211646.508225:0:8516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfc13c4400/0x2afbce82f55a535c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5355 expref: 18 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211646.508250:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1875075660809216:0@lo:104: 00000100:00100000:3.0:1788211646.508276:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788211646.509802:0:8516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc13c5c00/0x2afbce82f55a52fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a52f3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211646.509816:0:8516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfc13c5c00/0x2afbce82f55a52fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a52f3 expref: 18 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211646.509829:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1875075660809344:0@lo:104: 00000100:00100000:3.0:1788211646.509863:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca8e2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788211646.510120:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788211646.510142:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211646.510154:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660809088 00000100:00100000:0.0:1788211646.510161:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660809088 00000100:00100000:0.0:1788211646.510466:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660809216 00000100:00100000:0.0:1788211646.510470:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660809216 00000100:00100000:0.0:1788211646.510482:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660809344 00000100:00100000:0.0:1788211646.510483:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660809344 00000100:00100000:0.0:1788211646.510496:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788211646.510504:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+5:8516:x1875075660809088:12345-0@lo:104: 00010000:00010000:0.0:1788211646.510530:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5427 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211646.510728:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1875075660809088:0@lo:104: 00010000:00010000:0.0:1788211646.510804:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788211646.510811:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+5:8516:x1875075660809088:12345-0@lo:104: Request processed in 308us (2704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211646.510818:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788211646.510835:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788211646.510841:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef612850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+4:8516:x1875075660809216:12345-0@lo:104: 00010000:00010000:0.0:1788211646.510849:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a535c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211646.510917:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1875075660809216:0@lo:104: 00000100:00100000:1.0:1788211646.510959:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:1.0:1788211646.510964:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788211646.510972:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1788211646.511419:0:8518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788211646.511428:0:8518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe288a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:afe7852e-b478-4e21-8864-7e739fb0a137+4:8516:x1875075660809344:12345-0@lo:104: 00010000:00010000:1.0:1788211646.511437:0:8518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8ac0020c1a00/0x2afbce82f55a52f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a52fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511532:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788211646.511550:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5427 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511559:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063600 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:2.0:1788211646.511564:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a5427 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511572:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a5427 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211646.511579:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a5427 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211646.511594:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788211646.511641:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5427 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511662:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788211646.511688:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5427 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511694:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abec6063600/0x2afbce82f55a5420 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5427 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511705:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788211646.511708:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a535c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511713:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c5e00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:2.0:1788211646.511716:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a535c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511722:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a535c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211646.511728:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a535c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211646.511732:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788211646.511756:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a535c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511762:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788211646.511777:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a535c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511784:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5e00/0x2afbce82f55a5355 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a535c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511799:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211646.511802:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8ac0020c1a00/0x2afbce82f55a52f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a52fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511808:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c1a00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:2.0:1788211646.511810:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8ac0020c1a00/0x2afbce82f55a52f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a52fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511817:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8ac0020c1a00/0x2afbce82f55a52f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a52fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211646.511823:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8ac0020c1a00/0x2afbce82f55a52f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a52fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211646.511827:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788211646.511840:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8ac0020c1a00/0x2afbce82f55a52f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a52fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511846:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788211646.511851:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8ac0020c1a00/0x2afbce82f55a52f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a52fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511858:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8ac0020c1a00/0x2afbce82f55a52f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a52fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.511872:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211646.511874:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211646.511876:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211646.511892:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660809472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788211646.511940:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211646.512012:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660809600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788211646.512036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211646.512056:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211646.512061:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660809728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788211646.512079:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211646.512106:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660809472 00000100:00100000:2.0:1788211646.512111:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660809472 00010000:00010000:2.0:1788211646.512132:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abec6062600/0x2afbce82f55a5427 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5420 expref: 19 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211646.512147:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660809600 00000100:00100000:2.0:1788211646.512149:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660809600 00010000:00010000:2.0:1788211646.512156:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc13c4400/0x2afbce82f55a535c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5355 expref: 20 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211646.512416:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1875075660809344:0@lo:104: 00000100:00100000:2.0:1788211646.512542:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660809728 00000100:00100000:2.0:1788211646.512546:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660809728 00010000:00010000:2.0:1788211646.512563:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc13c5c00/0x2afbce82f55a52fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a52f3 expref: 21 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211646.512579:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788211646.512596:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+21:3311:x1875075660809472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788211646.512609:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211646.512615:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abec6062600/0x2afbce82f55a5427 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5420 expref: 21 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.512624:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abec6062600/0x2afbce82f55a5427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5420 expref: 21 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.512652:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6062600/0x2afbce82f55a5427 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5420 expref: 21 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.512666:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211646.512738:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+20:3311:x1875075660809472:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211646.512753:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788211646.512768:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788211646.512774:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe093480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660809600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788211646.512781:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211646.512785:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc13c4400/0x2afbce82f55a535c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5355 expref: 19 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.512792:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc13c4400/0x2afbce82f55a535c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5355 expref: 19 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.512802:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c4400/0x2afbce82f55a535c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5355 expref: 19 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.512809:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211646.512834:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe093480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+18:3308:x1875075660809600:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211646.512839:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788211646.512850:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788211646.512856:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+17:3308:x1875075660809728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788211646.512862:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211646.512866:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc13c5c00/0x2afbce82f55a52fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a52f3 expref: 17 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.512880:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc13c5c00/0x2afbce82f55a52fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a52f3 expref: 17 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.512890:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c5c00/0x2afbce82f55a52fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a52f3 expref: 17 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.512898:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211646.512919:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+16:3308:x1875075660809728:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211646.512924:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788211646.512949:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660809728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788211646.512956:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660809600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788211646.513418:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788211646.513428:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef612850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+4:8516:x1875075660809216:12345-0@lo:104: Request processed in 2585us (5149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211646.513436:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788211646.513534:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211646.513835:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660809472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788211646.513950:0:8518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788211646.513958:0:8518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe288a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:afe7852e-b478-4e21-8864-7e739fb0a137+3:8516:x1875075660809344:12345-0@lo:104: Request processed in 2530us (3814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211646.513964:0:8518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788211646.514024:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211646.515162:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1875075660808960:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211646.515380:0:8516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211646.516719:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211646.516850:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637712512 00000100:00100000:2.0:1788211646.516861:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637712512 00010000:00010000:2.0:1788211646.516908:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfcb37a800/0x2afbce82f55a54e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5716 expref: 10 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211646.516957:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:2.0:1788211646.516969:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2358:x1875075637712512:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211646.516987:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211646.517011:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfcb37a800/0x2afbce82f55a54e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5716 expref: 10 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.517023:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfcb37a800/0x2afbce82f55a54e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5716 expref: 10 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.517044:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37a800/0x2afbce82f55a54e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5716 expref: 10 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.517064:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.517071:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.517091:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.517098:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.517104:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.517111:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.517116:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211646.517121:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.517129:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.517160:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.518424:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211646.518522:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:2358:x1875075637712512:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1548us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211646.518533:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 24 00010000:00010000:3.0:1788211646.518660:0:8516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211646.518673:0:8516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211646.518679:0:8516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6063a00/0x2afbce82f55a5585 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211646.629461:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211647.658150:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211647.772191:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211647.772433:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637712640 00000100:00100000:2.0:1788211647.772445:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637712640 00000100:00100000:2.0:1788211647.772519:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 171 00000100:00100000:2.0:1788211647.772532:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:5602:x1875075637712640:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788211647.772551:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211647.772584:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abffdb80200/0x2afbce82f55a558c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5755 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211647.772616:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb80200/0x2afbce82f55a558c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5755 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211647.772632:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abffdb80200/0x2afbce82f55a558c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5755 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211647.772643:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80200, rc 0) 00000100:00100000:2.0:1788211647.772711:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5602:x1875075637712640:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 182us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211647.772719:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 171 00000100:00100000:1.0:1788211647.776430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211647.776464:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637712768 00000100:00100000:1.0:1788211647.776473:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637712768 00000100:00100000:1.0:1788211647.776518:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 172 00000100:00100000:1.0:1788211647.776528:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5602:x1875075637712768:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211647.776853:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5602:x1875075637712768:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 324us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211647.776861:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 172 00000100:00100000:2.0:1788211647.790339:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211647.791443:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637712896 00000100:00100000:1.0:1788211647.791458:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637712896 00000100:00100000:1.0:1788211647.791526:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 173 00000100:00100000:1.0:1788211647.791539:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5602:x1875075637712896:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788211647.791828:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:5602:x1875075637712896:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 290us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211647.791845:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 173 00000100:00100000:3.0:1788211647.797223:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211647.801471:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637713024 00000100:00100000:2.0:1788211647.801488:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637713024 00000100:00100000:2.0:1788211647.801557:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 174 00000100:00100000:2.0:1788211647.801577:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:6144:x1875075637713024:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788211647.801848:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:6144:x1875075637713024:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 271us (4634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211647.801857:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 174 00000100:00100000:1.0:1788211647.808502:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211647.808614:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637713152 00000100:00100000:2.0:1788211647.808626:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637713152 00000100:00100000:2.0:1788211647.808698:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 175 00000100:00100000:2.0:1788211647.808720:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:6144:x1875075637713152:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788211647.809002:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:6144:x1875075637713152:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 283us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211647.809011:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 175 10000000:01000000:1.0:1788211648.165245:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788211648.165256:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfcaf32000 from 4 10000000:01000000:1.0:1788211648.165262:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788211648.165320:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211648.165334:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211648.165349:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211648.165383:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660809856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788211648.165479:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211648.165541:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4ad9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788211648.165711:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660809856 00000100:00100000:0.0:1788211648.165728:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660809856 00000100:00100000:0.0:1788211648.165783:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788211648.165793:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660809856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211648.165810:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211648.165826:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a559a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5593 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211648.165851:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a559a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5593 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211648.165879:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a559a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5593 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211648.165890:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030200, rc 0) 00000100:00100000:0.0:1788211648.165962:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660809856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211648.165980:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788211648.166030:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660809856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211648.166046:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a559a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211648.166055:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a559a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211648.166111:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660809984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211648.166138:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211648.166154:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211648.166186:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660809984 00000100:00100000:0.0:1788211648.166190:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660809984 00000100:00100000:0.0:1788211648.166212:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788211648.166218:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660809984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211648.166792:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660809984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 571us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211648.166801:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788211648.166849:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660809984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211648.166892:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660810112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211648.166933:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211648.166949:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211648.167109:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660810112 00000100:00100000:0.0:1788211648.167115:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660810112 00000100:00100000:0.0:1788211648.167147:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788211648.167155:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660810112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211648.167357:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660810112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211648.167366:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788211648.167407:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660810112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211648.174106:0:8592:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8592:1875075660810240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211648.174220:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211648.174262:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660810240 00000100:00100000:0.0:1788211648.174268:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660810240 00000100:00100000:0.0:1788211648.174315:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788211648.174324:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:8592:x1875075660810240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788211648.174591:0:8592:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788211648.175283:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:8592:x1875075660810240:12345-0@lo:502:llog_process_th.0 Request processed in 955us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211648.175295:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788211648.175844:0:8592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8592:1875075660810240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788211648.175886:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788211648.175901:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211648.175903:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788211648.175909:0:8592:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abfcaf32000 00000020:00000080:1.0:1788211648.176035:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788211648.176134:0:8592:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8592:1875075660810368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788211648.176215:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211648.176259:0:8592:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4ad9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788211648.177078:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660810368 00000100:00100000:3.0:1788211648.177100:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660810368 00000100:00100000:3.0:1788211648.177156:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788211648.177188:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+17:8592:x1875075660810368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211648.177759:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+17:8592:x1875075660810368:12345-0@lo:502:llog_process_th.0 Request processed in 590us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211648.177769:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788211648.180140:0:8592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8592:1875075660810368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788211648.180547:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211648.180565:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211648.180568:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788211648.180573:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788211648.180810:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788211648.180845:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788211648.180858:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a559a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211648.180871:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a559a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211648.180882:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788211648.180885:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ac001fd6800 from 4 10000000:01000000:3.0:1788211648.180888:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788211648.180932:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211648.180941:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211648.180950:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211648.180984:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660810496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788211648.181054:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211648.181095:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788211648.181814:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660810496 00000100:00100000:1.0:1788211648.181823:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660810496 00000100:00100000:1.0:1788211648.181871:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788211648.181880:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660810496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211648.181893:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211648.181908:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a55a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a55a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211648.181943:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a55a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a55a1 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211648.181955:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a55a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a55a1 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211648.181964:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06800, rc 0) 00000100:00100000:1.0:1788211648.182082:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660810496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211648.182088:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788211648.182134:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660810496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211648.182149:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a55a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211648.182159:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a55a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211648.182251:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660810624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211648.182280:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211648.182297:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4ad9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788211648.182311:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660810624 00000100:00100000:1.0:1788211648.182314:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660810624 00000100:00100000:1.0:1788211648.182335:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788211648.182342:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660810624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211648.182598:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660810624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211648.182606:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788211648.182640:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660810624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211648.182667:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660810752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788211648.182705:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211648.183364:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4ad9540 going to sleep for 11 seconds 00000100:00100000:2.0:1788211648.183377:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660810752 00000100:00100000:2.0:1788211648.183384:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660810752 00000100:00100000:2.0:1788211648.183496:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788211648.183507:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660810752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211648.183736:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660810752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211648.183745:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788211648.183801:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660810752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211648.184667:0:8594:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8594:1875075660810880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211648.184744:0:8594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211648.184799:0:8594:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788211648.184892:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660810880 00000100:00100000:0.0:1788211648.184900:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660810880 00000100:00100000:0.0:1788211648.184957:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788211648.185108:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:8594:x1875075660810880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211648.185373:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:8594:x1875075660810880:12345-0@lo:502:llog_process_th.0 Request processed in 406us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211648.185387:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788211648.185489:0:8594:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8594:1875075660810880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788211648.185520:0:8594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211648.185530:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211648.185533:0:8594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788211648.185538:0:8594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac001fd6800 00000020:00000080:2.0:1788211648.185541:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788211648.185629:0:8594:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8594:1875075660811008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211648.185666:0:8594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211648.185692:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660811008 00000100:00100000:2.0:1788211648.185696:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660811008 00000100:00100000:2.0:1788211648.186694:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788211648.186708:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:8594:x1875075660811008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211648.187130:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:8594:x1875075660811008:12345-0@lo:502:llog_process_th.0 Request processed in 425us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211648.187140:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788211648.187223:0:8594:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211648.187242:0:8594:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8594:1875075660811008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788211648.187274:0:8594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211648.187280:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211648.187282:0:8594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788211648.187287:0:8594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788211648.187547:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788211648.187581:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788211648.187593:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a55a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211648.187605:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a55a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211648.187616:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788211648.187618:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfc288e800 from 4 10000000:01000000:0.0:1788211648.187621:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788211648.187651:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211648.187660:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211648.187668:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211648.187685:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe288380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660811136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788211648.187800:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211648.187824:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788211648.187841:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660811136 00000100:00100000:0.0:1788211648.187847:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660811136 00000100:00100000:0.0:1788211648.187884:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788211648.187893:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660811136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211648.187905:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211648.188057:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a55b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a55af expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211648.188083:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a55b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a55af expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211648.188094:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a55b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a55af expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211648.188104:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030a00, rc 0) 00000100:00100000:0.0:1788211648.188138:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660811136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211648.188144:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788211648.188197:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe288380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660811136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211648.188210:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a55b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211648.188219:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a55b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211648.188264:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe288380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660811264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211648.188288:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211648.188303:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788211648.188314:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660811264 00000100:00100000:0.0:1788211648.188318:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660811264 00000100:00100000:0.0:1788211648.188339:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788211648.188345:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660811264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211648.189263:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660811264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 914us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211648.189280:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788211648.189537:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe288380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660811264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211648.189599:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660811392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788211648.189959:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211648.190002:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104840 going to sleep for 11 seconds 00000100:00100000:0.0:1788211648.190057:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660811392 00000100:00100000:0.0:1788211648.190065:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660811392 00000100:00100000:0.0:1788211648.190118:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788211648.190128:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660811392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211648.190330:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660811392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211648.190337:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788211648.190383:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660811392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211648.190807:0:8595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8595:1875075660811520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211648.190850:0:8595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211648.190875:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660811520 00000100:00100000:0.0:1788211648.190880:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660811520 00000100:00100000:0.0:1788211648.190908:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788211648.190927:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:8595:x1875075660811520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211648.191361:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:8595:x1875075660811520:12345-0@lo:502:llog_process_th.0 Request processed in 434us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211648.191369:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788211648.191408:0:8595:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788211648.191423:0:8595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8595:1875075660811520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788211648.191595:0:8595:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211648.191607:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211648.191610:0:8595:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788211648.191617:0:8595:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abfc288e800 00000020:00000080:0.0:1788211648.191620:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788211648.191992:0:8595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8595:1875075660811648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211648.192033:0:8595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211648.194145:0:8595:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd879d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788211648.195712:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660811648 00000100:00100000:3.0:1788211648.195728:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660811648 00000100:00100000:3.0:1788211648.195801:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788211648.195813:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:8595:x1875075660811648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211648.196710:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:8595:x1875075660811648:12345-0@lo:502:llog_process_th.0 Request processed in 896us (4673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211648.196723:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788211648.196819:0:8595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:8595:1875075660811648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788211648.196861:0:8595:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211648.196870:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211648.196872:0:8595:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788211648.196955:0:8595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788211648.197399:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788211648.197756:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788211648.197768:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a55b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211648.197780:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a55b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211648.224633:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211648.224848:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637713280 00000100:00100000:1.0:1788211648.224861:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637713280 00000100:00100000:1.0:1788211648.224936:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:1.0:1788211648.224947:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637713280:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211648.225052:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211648.225078:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637713408 00000100:00100000:3.0:1788211648.225083:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637713408 00000100:00100000:2.0:1788211648.225091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211648.225112:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637713536 00000100:00100000:3.0:1788211648.225115:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637713536 00000100:00100000:3.0:1788211648.225136:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:3.0:1788211648.225144:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637713408:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211648.225243:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637713408:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 100us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211648.225252:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:3.0:1788211648.225279:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:3.0:1788211648.225285:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2360:x1875075637713536:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211648.225312:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2360:x1875075637713536:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211648.225317:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:1.0:1788211648.226629:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637713280:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 1673us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211648.226650:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00080000:1.0:1788211648.226686:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211648.226691:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788211648.226694:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211648.231231:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660811776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211648.231349:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211648.231431:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660811776 00000100:00100000:1.0:1788211648.233207:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660811776 00000100:00100000:1.0:1788211648.233305:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788211648.233316:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660811776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788211648.233358:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211648.233439:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660811776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211648.233448:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788211648.233523:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abff6463b80 x1875075660811776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211648.233543:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660811776:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788211648.234352:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788211648.680692:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211648.751945:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660811904:0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.753143:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211648.753227:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660812416:0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.753257:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211648.753289:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788211648.753296:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660812288:0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.753321:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211648.753359:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660812160:0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.753383:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211648.753403:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788211648.753410:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660812032:0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.753447:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211648.753477:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660812544:0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.753501:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211648.753532:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660812416 00000100:00100000:3.0:1788211648.753554:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660812416 00000100:00100000:3.0:1788211648.753623:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660812160 00000100:00100000:3.0:1788211648.753627:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660812160 00000100:00100000:3.0:1788211648.753641:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660812032 00000100:00100000:3.0:1788211648.753644:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660812032 00000100:00100000:3.0:1788211648.753657:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788211648.753673:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660812416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.753736:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660812416:12345-0@lo:400:kworker.0 Request processed in 64us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211648.753744:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788211648.753766:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788211648.753772:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660812160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.753805:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660812160:12345-0@lo:400:kworker.0 Request processed in 33us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211648.753810:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788211648.753822:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788211648.753828:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660812032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.753855:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660812032:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211648.753861:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788211648.753880:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660812288 00000100:00100000:3.0:1788211648.753884:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660812288 00000100:00100000:3.0:1788211648.753911:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660812544 00000100:00100000:3.0:1788211648.753913:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660812544 00000100:00100000:3.0:1788211648.753937:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788211648.753943:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660812288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211648.755216:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660811904 00000100:00100000:0.0:1788211648.755227:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660811904 00000100:00100000:3.0:1788211648.755518:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660812288:12345-0@lo:400:kworker.0 Request processed in 1574us (2194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211648.755527:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788211648.755555:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788211648.755565:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660812544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211648.755575:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788211648.755584:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660811904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.755595:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660812544:12345-0@lo:400:kworker.0 Request processed in 34us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211648.755607:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788211648.755616:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660811904:12345-0@lo:400:kworker.0 Request processed in 34us (2476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211648.755622:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:3.0:1788211648.755646:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788211648.755653:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211648.755843:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660812032:0@lo:400:kworker.0 00010000:00080000:3.0:1788211648.755859:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001364e00 x1875075660812544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211648.755870:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660812544:0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.755881:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660812160:0@lo:400:kworker.0 00010000:00080000:3.0:1788211648.755924:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001364a80 x1875075660812288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211648.755933:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660812288:0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.755944:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660811904:0@lo:400:kworker.0 00000100:00100000:3.0:1788211648.755969:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660812416:0@lo:400:kworker.0 00000100:00100000:2.0:1788211649.253414:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211649.253441:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660812672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211649.253561:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211649.253600:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660812672 00000100:00100000:1.0:1788211649.253609:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660812672 00000100:00100000:1.0:1788211649.253653:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788211649.253659:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788211649.253663:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660812672:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211649.253667:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788211649.253694:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211649.253754:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660812672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211649.253762:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788211649.253834:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe289c00 x1875075660812672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211665 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211649.253854:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660812672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788211649.701447:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211650.730063:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211651.751437:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211652.774278:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211653.341881:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211653.341940:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211653.342092:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637713664 00000100:00100000:3.0:1788211653.342104:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637713664 00000100:00100000:3.0:1788211653.342185:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 192 00000100:00100000:3.0:1788211653.342198:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc923a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2361:x1875075637713664:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211653.342471:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637713792 00000100:00100000:1.0:1788211653.342477:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637713792 00000100:00100000:1.0:1788211653.342534:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:1.0:1788211653.342543:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637713792:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211653.342650:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc923a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2361:x1875075637713664:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 453us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211653.342660:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 192 00000100:00100000:1.0:1788211653.346763:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637713792:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 4074us (4674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211653.346784:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00080000:1.0:1788211653.346841:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211653.347020:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211653.347130:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211653.348902:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637713920 00000100:00100000:1.0:1788211653.348921:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637713920 00000100:00100000:1.0:1788211653.348983:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637714048 00000100:00100000:1.0:1788211653.348986:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637714048 00000100:00100000:1.0:1788211653.349016:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:1.0:1788211653.349029:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637713920:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211653.349123:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637713920:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 95us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211653.349132:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:1.0:1788211653.349154:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1788211653.349163:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637714048:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211653.349212:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637714048:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 51us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211653.349220:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00080000:1.0:1788211653.349243:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211653.349254:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788211653.350830:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660812800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211653.350931:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211653.351036:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660812800 00000100:00100000:0.0:1788211653.351044:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660812800 00000100:00100000:0.0:1788211653.351118:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788211653.351130:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660812800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788211653.351192:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211653.351244:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660812800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211653.351251:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788211653.351288:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe288700 x1875075660812800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211653.351306:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660812800:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788211653.352208:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788211653.425815:0:8818:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788211653.800140:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211653.861970:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660812928:0@lo:400:kworker.0 00000100:00100000:1.0:1788211653.862071:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211653.862121:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660813440:0@lo:400:kworker.0 00000100:00100000:1.0:1788211653.862146:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211653.862188:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788211653.862194:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00132b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660813312:0@lo:400:kworker.0 00000100:00100000:1.0:1788211653.862218:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211653.862252:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660813312 00000100:00100000:1.0:1788211653.862260:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660813312 00000100:00100000:1.0:1788211653.862316:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788211653.862325:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660813312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211653.862387:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660813312:12345-0@lo:400:kworker.0 Request processed in 62us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211653.862395:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788211653.862453:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac00132b800 x1875075660813312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211653.862469:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00132b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660813312:0@lo:400:kworker.0 00000100:00100000:3.0:1788211653.862625:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660813184:0@lo:400:kworker.0 00000100:00100000:3.0:1788211653.862671:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211653.862703:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788211653.862709:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00132a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660813056:0@lo:400:kworker.0 00000100:00100000:3.0:1788211653.862731:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211653.862752:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00132bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660813568:0@lo:400:kworker.0 00000100:00100000:3.0:1788211653.862774:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211653.862803:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660813440 00000100:00100000:3.0:1788211653.862807:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660813440 00000100:00100000:3.0:1788211653.862847:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660813184 00000100:00100000:3.0:1788211653.862850:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660813184 00000100:00100000:3.0:1788211653.862863:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660813056 00000100:00100000:3.0:1788211653.862865:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660813056 00000100:00100000:3.0:1788211653.862877:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788211653.862883:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660813440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211653.862924:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660813440:12345-0@lo:400:kworker.0 Request processed in 40us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211653.862930:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788211653.862942:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788211653.862962:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660813184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211653.862990:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660813184:12345-0@lo:400:kworker.0 Request processed in 42us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211653.862996:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788211653.863007:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788211653.863012:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660813056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211653.863038:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660813056:12345-0@lo:400:kworker.0 Request processed in 26us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211653.863044:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788211653.863076:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660813568 00000100:00100000:3.0:1788211653.863080:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660813568 00000100:00100000:3.0:1788211653.863108:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788211653.863115:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660813568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211653.863143:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660813568:12345-0@lo:400:kworker.0 Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211653.863148:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788211653.863162:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788211653.863189:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211653.863216:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00132a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660813056:0@lo:400:kworker.0 00010000:00080000:3.0:1788211653.863226:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac00132bb80 x1875075660813568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211653.863235:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00132bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660813568:0@lo:400:kworker.0 00000100:00100000:3.0:1788211653.863243:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660813184:0@lo:400:kworker.0 00000100:00100000:3.0:1788211653.863276:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660813440:0@lo:400:kworker.0 00000100:00100000:2.0:1788211653.863488:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660812928 00000100:00100000:2.0:1788211653.863493:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660812928 00000100:00100000:2.0:1788211653.863520:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788211653.863526:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660812928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211653.863565:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660812928:12345-0@lo:400:kworker.0 Request processed in 40us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211653.863571:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788211653.863635:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660812928:0@lo:400:kworker.0 00000100:00100000:2.0:1788211654.378515:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211654.378545:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660813696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211654.378635:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211654.379667:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660813696 00000100:00100000:0.0:1788211654.379688:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660813696 00000100:00100000:0.0:1788211654.379762:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788211654.379774:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660813696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788211654.379814:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211654.379889:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660813696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211654.379897:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788211654.379944:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe090000 x1875075660813696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211670 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211654.379966:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660813696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788211654.824005:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211655.859568:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211656.869289:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211657.894661:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211658.462369:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211658.466946:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637714176 00000100:00100000:3.0:1788211658.466979:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637714176 00000100:00100000:3.0:1788211658.467083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 194 00000100:00100000:3.0:1788211658.467095:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2359:x1875075637714176:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211658.467210:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2359:x1875075637714176:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 117us (4862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211658.467219:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 194 00000100:00100000:1.0:1788211658.469494:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660813824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211658.469595:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211658.469907:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660813824 00000100:00100000:0.0:1788211658.469916:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660813824 00000100:00100000:0.0:1788211658.469991:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788211658.470003:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660813824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788211658.470047:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211658.470111:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660813824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211658.470119:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788211658.470186:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe288700 x1875075660813824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211658.470207:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660813824:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788211658.470651:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211658.470932:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211658.471015:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637714304 00000100:00100000:2.0:1788211658.471023:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637714304 00000100:00100000:2.0:1788211658.471094:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:2.0:1788211658.471104:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637714304:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211658.471187:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637714304:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211658.471208:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00080000:1.0:1788211658.471333:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211658.477017:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211658.482581:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637714432 00000100:00100000:3.0:1788211658.482628:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637714432 00000100:00100000:3.0:1788211658.482833:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:3.0:1788211658.483105:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2357:x1875075637714432:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:3.0:1788211658.483147:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a54f2 00000100:00080000:3.0:1788211658.483159:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8abec584a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788211658.483216:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788211658.483688:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+2:2357:x1875075637714432:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 843us (6682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211658.483701:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00010000:00010000:3.0:1788211658.483735:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788211658.485186:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211658.485345:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211658.485468:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637714560 00000100:00100000:1.0:1788211658.485479:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637714560 00000100:00100000:1.0:1788211658.485547:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:1.0:1788211658.485562:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2357:x1875075637714560:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:1.0:1788211658.485605:0:8290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a54f9 00000100:00080000:1.0:1788211658.485616:0:8290:0:(import.c:65:import_set_state_nolock()) ffff8abec6697000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788211658.485659:0:8290:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788211658.486233:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+2:2357:x1875075637714560:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 672us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211658.486243:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00010000:00010000:1.0:1788211658.486311:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788211658.486320:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1788211658.687003:0:9062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing yml_node 00010000:00010000:2.0:1788211658.923491:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211658.981711:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660813952:0@lo:400:kworker.0 00000100:00100000:1.0:1788211658.981812:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211658.981877:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660814464:0@lo:400:kworker.0 00000100:00100000:1.0:1788211658.981920:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211658.981971:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788211658.981977:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660814336:0@lo:400:kworker.0 00000100:00100000:1.0:1788211658.982008:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211658.982047:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00132b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660814080:0@lo:400:kworker.0 00000100:00100000:1.0:1788211658.982070:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211658.982086:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660814592:0@lo:400:kworker.0 00000100:00100000:1.0:1788211658.982105:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211658.982135:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211658.982140:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660814208:0@lo:400:kworker.0 00000100:00100000:1.0:1788211658.982205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211658.982249:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660813952 00000100:00100000:1.0:1788211658.982259:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660813952 00000100:00100000:1.0:1788211658.982312:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788211658.982322:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc923bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660813952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211658.982392:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc923bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660813952:12345-0@lo:400:kworker.0 Request processed in 71us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211658.982400:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788211658.982432:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660814464 00000100:00100000:1.0:1788211658.982436:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660814464 00000100:00100000:1.0:1788211658.982470:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660814080 00000100:00100000:1.0:1788211658.982473:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660814080 00000100:00100000:1.0:1788211658.982482:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660814208 00000100:00100000:1.0:1788211658.982484:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660814208 00000100:00100000:1.0:1788211658.982497:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788211658.982503:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660814464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211658.982534:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660814464:12345-0@lo:400:kworker.0 Request processed in 32us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211658.982540:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788211658.982553:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788211658.982559:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660814080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211658.982588:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660814080:12345-0@lo:400:kworker.0 Request processed in 29us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211658.982600:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788211658.982614:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788211658.982621:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660814208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211658.982662:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660814208:12345-0@lo:400:kworker.0 Request processed in 41us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211658.982667:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660814336 00000100:00100000:1.0:1788211658.982672:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788211658.982675:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660814336 00000100:00100000:1.0:1788211658.982703:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660814592 00000100:00100000:1.0:1788211658.982708:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660814592 00000100:00100000:3.0:1788211658.982719:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788211658.982731:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660814336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211658.982748:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788211658.982758:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660814592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211658.982809:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660814336:12345-0@lo:400:kworker.0 Request processed in 81us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211658.982812:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660814592:12345-0@lo:400:kworker.0 Request processed in 55us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211658.982822:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788211658.983802:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788211658.983837:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211658.983842:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211658.983895:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00132aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660814208:0@lo:400:kworker.0 00010000:00080000:0.0:1788211658.984248:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001329f80 x1875075660814336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211658.984262:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660814336:0@lo:400:kworker.0 00000100:00100000:0.0:1788211658.984286:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660813952:0@lo:400:kworker.0 00000100:00100000:0.0:1788211658.984300:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660814464:0@lo:400:kworker.0 00000100:00100000:1.0:1788211658.985201:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00132b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660814080:0@lo:400:kworker.0 00010000:00080000:1.0:1788211658.985244:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001328380 x1875075660814592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211658.985260:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660814592:0@lo:400:kworker.0 00000100:00100000:3.0:1788211659.493937:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660814720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211659.494017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211659.494293:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660814720 00000100:00100000:2.0:1788211659.494302:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660814720 00000100:00100000:2.0:1788211659.494372:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788211659.494383:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660814720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211659.494421:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211659.506116:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660814720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11724us (12088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211659.506131:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788211659.509431:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe093b80 x1875075660814720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211659.509463:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660814720:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788211659.569502:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000020:00000080:3.0:1788211659.569517:0:6720:0:(genops.c:885:class_export_put()) final put ffff8abec584e800/a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000020:00000080:3.0:1788211659.569565:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec584e800/a688ef06-7eb0-4c47-9425-de9843f5c0e0 for lustre-OST0000 00000020:00000080:3.0:1788211659.575079:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec584a000 for lustre-OST0000 00010000:00010000:1.0:1788211659.943956:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211660.966516:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211661.990034:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788211662.667289:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000020:00000080:2.0:1788211662.667303:0:7655:0:(genops.c:885:class_export_put()) final put ffff8abec6696800/a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000020:00000080:0.0:1788211662.667385:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec6696800/a688ef06-7eb0-4c47-9425-de9843f5c0e0 for lustre-OST0001 00000020:00000080:0.0:1788211662.667456:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec6697000 for lustre-OST0001 00010000:00010000:2.0:1788211663.015957:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788211663.324936:0:9253:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.85 00000100:00100000:3.0:1788211663.577620:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211663.577663:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211663.577739:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637714816 00000100:00100000:1.0:1788211663.577749:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637714816 00000100:00100000:1.0:1788211663.577818:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:1.0:1788211663.577830:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637714816:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211663.577912:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637714816:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211663.577937:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00080000:1.0:1788211663.577963:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211663.586930:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637714688 00000100:00100000:0.0:1788211663.586945:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637714688 00000100:00100000:0.0:1788211663.587013:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 196 00000100:00100000:0.0:1788211663.587024:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc923b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2360:x1875075637714688:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211663.587120:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc923b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2360:x1875075637714688:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 98us (9456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211663.587127:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 196 00000100:00100000:1.0:1788211663.589700:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660814848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211663.589782:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211663.590001:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660814848 00000100:00100000:0.0:1788211663.590011:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660814848 00000100:00100000:0.0:1788211663.590078:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788211663.590089:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660814848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788211663.590129:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788211663.590387:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788211663.590527:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660814848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 438us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211663.590535:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788211663.591896:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe288700 x1875075660814848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211663.591926:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660814848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788211664.037406:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211664.104279:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660814976:0@lo:400:kworker.0 00000100:00100000:3.0:1788211664.104889:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211664.104949:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660815488:0@lo:400:kworker.0 00000100:00100000:3.0:1788211664.104977:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211664.105011:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788211664.105018:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660815360:0@lo:400:kworker.0 00000100:00100000:3.0:1788211664.105045:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211664.105086:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660815104:0@lo:400:kworker.0 00000100:00100000:3.0:1788211664.105110:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211664.105130:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660815616:0@lo:400:kworker.0 00000100:00100000:3.0:1788211664.105150:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211664.105191:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788211664.105197:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660815232:0@lo:400:kworker.0 00000100:00100000:3.0:1788211664.105218:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211664.105264:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660814976 00000100:00100000:3.0:1788211664.105272:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660814976 00000100:00100000:3.0:1788211664.106487:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788211664.106506:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660814976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211664.106964:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660814976:12345-0@lo:400:kworker.0 Request processed in 463us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211664.106973:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788211664.107030:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660815488 00000100:00100000:3.0:1788211664.107041:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660815488 00000100:00100000:3.0:1788211664.107146:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660815104 00000100:00100000:3.0:1788211664.107195:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660815104 00000100:00100000:3.0:1788211664.107215:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660815232 00000100:00100000:3.0:1788211664.107218:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660815232 00000100:00100000:0.0:1788211664.107515:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788211664.107531:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660815488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211664.107616:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660815488:12345-0@lo:400:kworker.0 Request processed in 91us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211664.107623:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788211664.107651:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788211664.107674:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660815104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211664.107720:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660815104:12345-0@lo:400:kworker.0 Request processed in 61us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211664.107728:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788211664.110978:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211664.113947:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788211664.113971:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660815232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211664.114126:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660815232:12345-0@lo:400:kworker.0 Request processed in 163us (8905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211664.114135:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788211664.114206:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660815360 00000100:00100000:3.0:1788211664.114215:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660815360 00000100:00100000:3.0:1788211664.114262:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660815616 00000100:00100000:3.0:1788211664.114267:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660815616 00000100:00100000:2.0:1788211664.114673:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788211664.114687:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660815360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211664.114751:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660815360:12345-0@lo:400:kworker.0 Request processed in 69us (9704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211664.114758:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788211664.114845:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef8a5880 x1875075660815360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211664.114871:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660815360:0@lo:400:kworker.0 00000100:00100000:2.0:1788211664.114904:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660814976:0@lo:400:kworker.0 00000100:00100000:2.0:1788211664.114921:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660815488:0@lo:400:kworker.0 00000100:00080000:1.0:1788211664.117438:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788211664.117696:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788211664.117718:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660815616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211664.117861:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660815616:12345-0@lo:400:kworker.0 Request processed in 152us (12707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211664.117872:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788211664.117927:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660815232:0@lo:400:kworker.0 00000100:00100000:2.0:1788211664.117949:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660815104:0@lo:400:kworker.0 00010000:00080000:2.0:1788211664.118353:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef8a6d80 x1875075660815616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211664.118367:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660815616:0@lo:400:kworker.0 00000100:00100000:2.0:1788211664.614459:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660815744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211664.614551:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211664.614642:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660815744 00000100:00100000:2.0:1788211664.614652:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660815744 00000100:00100000:2.0:1788211664.614725:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788211664.614735:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660815744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211664.614772:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211664.614818:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660815744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211664.614826:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788211664.614871:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe093b80 x1875075660815744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211664.614893:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660815744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788211665.062253:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788211665.813058:0:9351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.85 00010000:00010000:1.0:1788211666.085441:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211667.109459:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211668.134530:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211668.704112:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211668.704209:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211668.704291:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637714944 00000100:00100000:1.0:1788211668.704302:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637714944 00000100:00100000:1.0:1788211668.704354:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 198 00000100:00100000:1.0:1788211668.704364:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2358:x1875075637714944:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211668.704424:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637715072 00000100:00100000:3.0:1788211668.704429:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637715072 00000100:00100000:1.0:1788211668.704446:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2358:x1875075637714944:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211668.704455:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 198 00000100:00100000:3.0:1788211668.704483:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:3.0:1788211668.704493:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637715072:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211668.704532:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637715072:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 41us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211668.704538:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00080000:3.0:1788211668.705381:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211668.711666:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788211668.711703:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660815872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211668.711819:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211668.712112:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660815872 00000100:00100000:1.0:1788211668.712124:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660815872 00000100:00080000:0.0:1788211668.712231:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211668.714432:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788211668.714449:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660815872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788211668.714494:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211668.714584:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660815872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211668.718124:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788211668.718280:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe288000 x1875075660815872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211668.718329:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660815872:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788211668.813446:0:9448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.85 00010000:00010000:0.0:1788211669.157333:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211669.222127:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660816128:0@lo:400:kworker.0 00000100:00100000:1.0:1788211669.222203:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660816000:0@lo:400:kworker.0 00000100:00100000:2.0:1788211669.222328:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660816384:0@lo:400:kworker.0 00000100:00100000:1.0:1788211669.227479:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211669.227621:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660816512:0@lo:400:kworker.0 00000100:00100000:1.0:1788211669.227725:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211669.227801:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660816512 00000100:00100000:1.0:1788211669.227809:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660816512 00000100:00100000:1.0:1788211669.227868:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788211669.227877:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660816512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211669.227929:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660816512:12345-0@lo:400:kworker.0 Request processed in 53us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211669.227936:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788211669.227982:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef8a5c00 x1875075660816512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211669.227997:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660816512:0@lo:400:kworker.0 00000100:00100000:0.0:1788211669.228683:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660816000 00000100:00100000:0.0:1788211669.228690:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660816000 00000100:00100000:0.0:1788211669.228730:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788211669.228739:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660816000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211669.228792:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660816000:12345-0@lo:400:kworker.0 Request processed in 55us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211669.228798:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1788211669.228826:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788211669.228849:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660816000:0@lo:400:kworker.0 00000100:00100000:1.0:1788211669.233070:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660816256:0@lo:400:kworker.0 00000100:00100000:1.0:1788211669.233264:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211669.233343:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211669.233561:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660816256 00000100:00100000:3.0:1788211669.233571:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660816256 00000100:00100000:3.0:1788211669.233631:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660816128 00000100:00100000:3.0:1788211669.233635:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660816128 00000100:00100000:3.0:1788211669.233657:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788211669.233669:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660816256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211669.233732:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660816256:12345-0@lo:400:kworker.0 Request processed in 65us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211669.233741:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788211669.233759:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788211669.233765:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660816128:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788211669.234056:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211669.234318:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660816256:0@lo:400:kworker.0 00000100:00100000:3.0:1788211669.237048:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660816128:12345-0@lo:400:kworker.0 Request processed in 3269us (3690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211669.237063:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788211669.238512:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211669.239891:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660816384 00000100:00100000:3.0:1788211669.239906:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660816384 00000100:00100000:3.0:1788211669.240002:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788211669.240013:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660816384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211669.240117:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660816384:12345-0@lo:400:kworker.0 Request processed in 93us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211669.240126:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788211669.240191:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211669.240294:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660816384:0@lo:400:kworker.0 00000100:00100000:0.0:1788211669.246517:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660816128:0@lo:400:kworker.0 00000100:00100000:0.0:1788211669.734025:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660816640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788211669.734120:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211669.734426:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660816640 00000100:00100000:3.0:1788211669.734435:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660816640 00000100:00100000:3.0:1788211669.734500:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788211669.734511:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660816640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211669.736905:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211669.737052:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660816640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2540us (2929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211669.737077:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788211669.741432:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef8a4700 x1875075660816640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211669.741478:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660816640:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788211670.181676:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211671.205463:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788211671.738499:0:9497:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 31 17:27:48 EDT 2026 00010000:00010000:3.0:1788211672.230274:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211673.255197:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211673.829694:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211673.829718:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660816768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788211673.829810:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211673.829971:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660816768 00000100:00100000:0.0:1788211673.829979:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660816768 00000100:00100000:0.0:1788211673.830049:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788211673.830070:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660816768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788211673.830110:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211673.830159:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660816768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211673.830194:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788211673.830319:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788211673.830590:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe288700 x1875075660816768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211673.830610:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660816768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211673.831992:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211673.832037:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211673.832077:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637715328 00000100:00100000:1.0:1788211673.832101:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637715328 00000100:00100000:1.0:1788211673.832160:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:1.0:1788211673.832193:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637715328:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211673.832273:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637715328:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211673.832280:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00080000:1.0:1788211673.832302:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211673.839649:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637715200 00000100:00100000:3.0:1788211673.839669:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637715200 00000100:00100000:3.0:1788211673.839806:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 200 00000100:00100000:3.0:1788211673.839818:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2359:x1875075637715200:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211673.839906:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2359:x1875075637715200:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 89us (7920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211673.839914:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 200 00010000:00010000:3.0:1788211674.278284:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211674.346450:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660817024:0@lo:400:kworker.0 00000100:00100000:0.0:1788211674.346535:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211674.346588:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788211674.346594:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660816896:0@lo:400:kworker.0 00000100:00100000:0.0:1788211674.346621:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211674.346643:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660817408:0@lo:400:kworker.0 00000100:00100000:0.0:1788211674.346667:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211674.346690:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660817152:0@lo:400:kworker.0 00000100:00100000:0.0:1788211674.346712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211674.346728:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211674.346733:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660817280:0@lo:400:kworker.0 00000100:00100000:0.0:1788211674.346752:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211674.346782:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660816896 00000100:00100000:0.0:1788211674.346789:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660816896 00000100:00100000:0.0:1788211674.346831:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788211674.346853:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660816896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211674.346904:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660816896:12345-0@lo:400:kworker.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211674.346911:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788211674.346944:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660817024 00000100:00100000:0.0:1788211674.346947:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660817024 00000100:00100000:0.0:1788211674.346968:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660817152 00000100:00100000:0.0:1788211674.346971:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660817152 00000100:00100000:0.0:1788211674.346993:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660817280 00000100:00100000:0.0:1788211674.346996:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660817280 00000100:00100000:0.0:1788211674.347010:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788211674.347016:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660817024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211674.347060:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660817024:12345-0@lo:400:kworker.0 Request processed in 43us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211674.347067:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788211674.347079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788211674.347085:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660817152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211674.347115:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660817152:12345-0@lo:400:kworker.0 Request processed in 30us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211674.347122:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788211674.347133:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788211674.347139:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660817280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211674.347162:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660817280:12345-0@lo:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211674.347195:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788211674.347347:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211674.347379:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660817280:0@lo:400:kworker.0 00000100:00100000:0.0:1788211674.347400:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660817152:0@lo:400:kworker.0 00000100:00100000:0.0:1788211674.347428:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660816896:0@lo:400:kworker.0 00000100:00100000:0.0:1788211674.347438:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660817024:0@lo:400:kworker.0 00000100:00100000:3.0:1788211674.348772:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660817408 00000100:00100000:3.0:1788211674.348783:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660817408 00000100:00100000:3.0:1788211674.348842:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788211674.348851:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660817408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211674.348926:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660817408:12345-0@lo:400:kworker.0 Request processed in 76us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211674.348933:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788211674.348981:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe28a680 x1875075660817408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211674.348994:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660817408:0@lo:400:kworker.0 00000100:00080000:0.0:1788211674.350558:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788211674.853324:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788211674.853349:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660817536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211674.853429:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211674.853508:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660817536 00000100:00100000:2.0:1788211674.853515:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660817536 00000100:00100000:2.0:1788211674.853561:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788211674.853571:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660817536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211674.853606:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211674.853648:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660817536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211674.853655:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788211674.853699:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffde67b80 x1875075660817536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211674.853717:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660817536:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788211675.302418:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211676.325486:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211677.353823:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211678.373377:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211678.941070:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211678.941128:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211678.941186:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637715584 00000100:00100000:3.0:1788211678.941208:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637715584 00000100:00100000:3.0:1788211678.941291:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:3.0:1788211678.941304:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637715584:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211678.941416:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637715584:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 115us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211678.941425:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00080000:3.0:1788211678.941453:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211678.941802:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637715456 00000100:00100000:1.0:1788211678.941808:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637715456 00000100:00100000:1.0:1788211678.941846:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 202 00000100:00100000:1.0:1788211678.941855:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2361:x1875075637715456:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211678.941892:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2361:x1875075637715456:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 39us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211678.941899:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 202 00000100:00100000:3.0:1788211678.960188:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660817664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211678.960288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211678.960387:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660817664 00000100:00100000:3.0:1788211678.960395:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660817664 00000100:00100000:3.0:1788211678.960458:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788211678.960470:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660817664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788211678.960510:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211678.960558:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660817664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211678.960566:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788211678.960589:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788211678.960740:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef8a4e00 x1875075660817664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211678.960759:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660817664:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788211679.400435:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211679.461682:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211679.463797:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788211679.463821:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660818176:0@lo:400:kworker.0 00000100:00100000:0.0:1788211679.463894:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211679.463969:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660818176 00000100:00100000:0.0:1788211679.463976:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660818176 00000100:00100000:0.0:1788211679.464034:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788211679.464045:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875075660818176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211679.464098:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875075660818176:12345-0@lo:400:kworker.0 Request processed in 56us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211679.464105:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788211679.464127:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211679.464157:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660818176:0@lo:400:kworker.0 00000100:00100000:2.0:1788211679.464613:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660817920:0@lo:400:kworker.0 00000100:00100000:2.0:1788211679.464650:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211679.464677:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788211679.464683:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660818048:0@lo:400:kworker.0 00000100:00100000:2.0:1788211679.464705:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211679.464734:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660817920 00000100:00100000:2.0:1788211679.464739:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660817920 00000100:00100000:2.0:1788211679.464764:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660818048 00000100:00100000:2.0:1788211679.464768:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660818048 00000100:00100000:1.0:1788211679.465187:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660817792:0@lo:400:kworker.0 00000100:00100000:1.0:1788211679.465228:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211679.465464:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660817792 00000100:00100000:3.0:1788211679.465470:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660817792 00000100:00100000:3.0:1788211679.465514:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788211679.465522:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660817792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211679.465568:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660817792:12345-0@lo:400:kworker.0 Request processed in 47us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211679.465586:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788211679.465633:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660817792:0@lo:400:kworker.0 00000100:00100000:3.0:1788211679.465648:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788211679.465653:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660818304:0@lo:400:kworker.0 00000100:00100000:3.0:1788211679.465681:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211679.465707:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660818304 00000100:00100000:3.0:1788211679.465711:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660818304 00000100:00100000:3.0:1788211679.465738:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788211679.465744:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660818304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211679.465775:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660818304:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211679.465781:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788211679.465819:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001367b80 x1875075660818304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211679.465830:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660818304:0@lo:400:kworker.0 00000100:00100000:0.0:1788211679.466119:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788211679.466130:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660817920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211679.466208:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660817920:12345-0@lo:400:kworker.0 Request processed in 80us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211679.466215:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788211679.466232:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788211679.466239:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660818048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211679.466268:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660818048:12345-0@lo:400:kworker.0 Request processed in 30us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211679.466283:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788211679.466303:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788211679.466308:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211679.467026:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660818048:0@lo:400:kworker.0 00000100:00100000:3.0:1788211679.467040:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660817920:0@lo:400:kworker.0 00000100:00100000:1.0:1788211679.973337:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660818432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211679.973417:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211679.973530:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660818432 00000100:00100000:2.0:1788211679.973539:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660818432 00000100:00100000:2.0:1788211679.973601:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788211679.973613:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660818432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211679.973652:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211679.973705:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660818432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211679.973712:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788211679.973750:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffde64e00 x1875075660818432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211679.973769:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660818432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788211680.421543:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211681.451082:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211682.469981:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211683.494004:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211684.057490:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211684.057578:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211684.057653:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637715840 00000100:00100000:1.0:1788211684.057663:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637715840 00000100:00100000:1.0:1788211684.057734:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:1.0:1788211684.057744:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637715840:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211684.057822:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637715840:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 79us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211684.057828:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00080000:3.0:1788211684.057955:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211684.058109:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637715712 00000100:00100000:0.0:1788211684.058114:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637715712 00000100:00100000:0.0:1788211684.058141:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 204 00000100:00100000:0.0:1788211684.058149:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2361:x1875075637715712:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211684.058220:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2361:x1875075637715712:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 71us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211684.058227:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 204 00000100:00100000:1.0:1788211684.070432:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788211684.070460:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660818560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211684.070535:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211684.070646:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660818560 00000100:00100000:3.0:1788211684.070655:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660818560 00000100:00100000:3.0:1788211684.070724:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788211684.070733:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660818560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788211684.070787:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211684.070837:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660818560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211684.070844:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788211684.070944:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788211684.070975:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001366680 x1875075660818560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211684.070995:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660818560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788211684.518676:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211684.583217:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660818816:0@lo:400:kworker.0 00000100:00100000:2.0:1788211684.583237:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660818688:0@lo:400:kworker.0 00000100:00100000:2.0:1788211684.589422:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211684.589521:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660819200:0@lo:400:kworker.0 00000100:00100000:2.0:1788211684.589584:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211684.589645:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660818944:0@lo:400:kworker.0 00000100:00100000:2.0:1788211684.589677:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211684.589700:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788211684.589707:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660819072:0@lo:400:kworker.0 00000100:00100000:2.0:1788211684.589752:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211684.589861:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660818688 00000100:00100000:2.0:1788211684.589871:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660818688 00000100:00100000:2.0:1788211684.590320:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788211684.590331:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660818688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211684.595273:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660818944 00000100:00100000:1.0:1788211684.595299:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660818944 00000100:00100000:1.0:1788211684.595408:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660819072 00000100:00100000:1.0:1788211684.595412:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660819072 00000100:00100000:1.0:1788211684.595443:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788211684.595455:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660818944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211684.601135:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788211684.601317:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211684.601343:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660819200 00000100:00100000:0.0:1788211684.601356:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660819200 00000100:00100000:0.0:1788211684.601439:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788211684.601452:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660819200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211684.601563:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660819200:12345-0@lo:400:kworker.0 Request processed in 114us (11977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211684.601571:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788211684.601598:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660818816 00000100:00100000:0.0:1788211684.601602:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660818816 00000100:00100000:0.0:1788211684.601623:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788211684.601632:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660819072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211684.604480:0:5845:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788211684.604511:0:5845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788211684.604547:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788211684.607304:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788211684.607336:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660818816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211684.614984:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660819072:12345-0@lo:400:kworker.0 Request processed in 13328us (25216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211684.615130:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788211684.615408:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788211684.615652:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660818944:12345-0@lo:400:kworker.0 Request processed in 20195us (25968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211684.615663:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788211684.616713:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660818688:0@lo:400:kworker.0 00010000:00080000:3.0:1788211684.619421:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffde67480 x1875075660819200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211684.619440:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660819200:0@lo:400:kworker.0 00000100:00100000:1.0:1788211684.619561:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660818816:12345-0@lo:400:kworker.0 Request processed in 12233us (18434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211684.619574:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788211684.619670:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660818816:0@lo:400:kworker.0 00000100:00100000:0.0:1788211684.621285:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660819072:0@lo:400:kworker.0 00000100:00100000:0.0:1788211684.621306:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660818944:0@lo:400:kworker.0 00000100:00100000:2.0:1788211684.624069:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660818688:12345-0@lo:400:kworker.0 Request processed in 33722us (34640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211684.624089:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788211685.104074:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788211685.104103:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660819328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211685.104205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211685.104358:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660819328 00000100:00100000:3.0:1788211685.104368:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660819328 00000100:00100000:3.0:1788211685.104498:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788211685.104509:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660819328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211685.104550:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211685.104602:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660819328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211685.104609:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788211685.104652:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001364e00 x1875075660819328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211685.104672:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660819328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788211685.563796:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211686.568091:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211687.589402:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211688.615985:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211689.182873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211689.182923:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211689.183073:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637715968 00000100:00100000:0.0:1788211689.183084:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637715968 00000100:00100000:0.0:1788211689.183150:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 206 00000100:00100000:0.0:1788211689.183162:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2359:x1875075637715968:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211689.183296:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2359:x1875075637715968:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 137us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211689.183304:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 206 00000100:00100000:2.0:1788211689.183940:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637716096 00000100:00100000:2.0:1788211689.183946:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637716096 00000100:00100000:2.0:1788211689.184011:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:2.0:1788211689.184022:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637716096:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211689.184069:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637716096:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 50us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211689.184076:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00080000:0.0:1788211689.184138:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211689.189866:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660819456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211689.189975:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211689.190239:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660819456 00000100:00100000:3.0:1788211689.190260:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660819456 00000100:00100000:3.0:1788211689.190332:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788211689.190342:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660819456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788211689.190376:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211689.190427:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660819456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211689.190434:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788211689.190486:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001366680 x1875075660819456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211689.190506:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660819456:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788211689.190919:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788211689.648706:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211689.702828:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660819584:0@lo:400:kworker.0 00000100:00100000:0.0:1788211689.702950:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211689.703011:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660820096:0@lo:400:kworker.0 00000100:00100000:0.0:1788211689.703044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211689.703088:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788211689.703095:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660819968:0@lo:400:kworker.0 00000100:00100000:0.0:1788211689.703121:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211689.703152:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660819712:0@lo:400:kworker.0 00000100:00100000:2.0:1788211689.703500:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660819584 00000100:00100000:2.0:1788211689.703511:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660819584 00000100:00100000:2.0:1788211689.703577:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788211689.703596:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660819584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211689.704097:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660819584:12345-0@lo:400:kworker.0 Request processed in 503us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211689.704105:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788211689.704368:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660819584:0@lo:400:kworker.0 00000100:00100000:0.0:1788211689.704404:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660820096 00000100:00100000:0.0:1788211689.704410:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660820096 00000100:00100000:0.0:1788211689.704900:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788211689.705016:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660820096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211689.705082:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660820096:12345-0@lo:400:kworker.0 Request processed in 175us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211689.705089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788211689.705126:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660820096:0@lo:400:kworker.0 00000100:00100000:3.0:1788211689.705295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211689.705329:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660820224:0@lo:400:kworker.0 00000100:00100000:3.0:1788211689.705359:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211689.705383:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788211689.705390:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660819840:0@lo:400:kworker.0 00000100:00100000:3.0:1788211689.705411:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211689.705451:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660819968 00000100:00100000:3.0:1788211689.705458:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660819968 00000100:00100000:3.0:1788211689.705490:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660820224 00000100:00100000:3.0:1788211689.705493:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660820224 00000100:00100000:0.0:1788211689.705571:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660819712 00000100:00100000:0.0:1788211689.705575:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660819712 00000100:00100000:0.0:1788211689.705598:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660819840 00000100:00100000:0.0:1788211689.705600:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660819840 00000100:00080000:2.0:1788211689.705719:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788211689.705724:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211689.706019:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788211689.706028:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660819968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211689.706081:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660819968:12345-0@lo:400:kworker.0 Request processed in 54us (2958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211689.706101:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788211689.706117:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788211689.706123:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660820224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211689.706157:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660820224:12345-0@lo:400:kworker.0 Request processed in 34us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211689.706162:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788211689.706288:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788211689.706296:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660819712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211689.706328:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660819712:12345-0@lo:400:kworker.0 Request processed in 33us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211689.706335:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788211689.706388:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660819712:0@lo:400:kworker.0 00010000:00080000:3.0:1788211689.706403:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffdc7f800 x1875075660820224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211689.706414:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660820224:0@lo:400:kworker.0 00010000:00080000:3.0:1788211689.706448:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef8a4700 x1875075660819968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211689.706458:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660819968:0@lo:400:kworker.0 00000100:00100000:0.0:1788211689.706539:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788211689.706547:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660819840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211689.706595:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660819840:12345-0@lo:400:kworker.0 Request processed in 49us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211689.706601:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788211689.707000:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660819840:0@lo:400:kworker.0 00000001:02000400:3.0:1788211690.071455:0:10128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 17:28:08 (1788211688) === 00000100:00100000:3.0:1788211690.216285:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788211690.216312:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660820352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211690.216402:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211690.216889:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660820352 00000100:00100000:3.0:1788211690.216901:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660820352 00000100:00100000:3.0:1788211690.217008:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788211690.217019:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660820352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211690.217066:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211690.217123:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660820352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211690.217132:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788211690.232190:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffde65180 x1875075660820352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211690.232225:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660820352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211690.520333:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211690.520440:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637716224 00000100:00100000:1.0:1788211690.520456:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637716224 00000100:00100000:1.0:1788211690.520549:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 208 00000100:00100000:1.0:1788211690.520564:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:8140:x1875075637716224:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788211690.520612:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211690.520648:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b07800/0x2afbce82f55a55bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f575c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211690.520701:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b07800/0x2afbce82f55a55bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f575c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211690.520714:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b07800/0x2afbce82f55a55bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f575c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211690.520726:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07800, rc 0) 00000100:00100000:1.0:1788211690.520838:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:8140:x1875075637716224:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 276us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211690.520846:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 208 00000100:00100000:1.0:1788211690.532531:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211690.535409:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637716352 00000100:00100000:0.0:1788211690.535428:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637716352 00000100:00100000:0.0:1788211690.535514:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 209 00000100:00100000:0.0:1788211690.535527:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:8140:x1875075637716352:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788211690.535893:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:8140:x1875075637716352:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 366us (3372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211690.535910:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 209 00000100:00100000:0.0:1788211690.548425:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211690.548551:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637716480 00000100:00100000:2.0:1788211690.548564:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637716480 00000100:00100000:2.0:1788211690.548626:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 210 00000100:00100000:2.0:1788211690.548638:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:8140:x1875075637716480:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788211690.549897:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:8140:x1875075637716480:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 309us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211690.549912:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 210 00000100:00100000:3.0:1788211690.552438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211690.552751:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637716608 00000100:00100000:1.0:1788211690.552763:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637716608 00000100:00100000:1.0:1788211690.552841:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 211 00000100:00100000:1.0:1788211690.552853:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:8144:x1875075637716608:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788211690.555623:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:8144:x1875075637716608:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 2760us (3183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211690.555639:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 211 00000100:00100000:1.0:1788211690.593344:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211690.594386:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637716736 00000100:00100000:2.0:1788211690.594401:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637716736 00000100:00100000:2.0:1788211690.594474:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 212 00000100:00100000:2.0:1788211690.594494:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:8144:x1875075637716736:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788211690.594930:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:8144:x1875075637716736:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 435us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211690.594939:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 212 00000100:00100000:0.0:1788211690.608945:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211690.609061:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637716864 00000100:00100000:1.0:1788211690.609072:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637716864 00000100:00100000:1.0:1788211690.609156:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 213 00000100:00100000:1.0:1788211690.609200:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:8140:x1875075637716864:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788211690.609247:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211690.609272:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b07000/0x2afbce82f55a55c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5786 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211690.609313:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b07000/0x2afbce82f55a55c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5786 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211690.609325:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b07000/0x2afbce82f55a55c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5786 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211690.609335:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07000, rc 0) 00000100:00100000:1.0:1788211690.609412:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:8140:x1875075637716864:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 246us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211690.609421:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 213 00000100:00100000:3.0:1788211690.616851:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211690.617105:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637716992 00000100:00100000:0.0:1788211690.617120:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637716992 00000100:00100000:0.0:1788211690.617245:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 214 00000100:00100000:0.0:1788211690.617257:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:8140:x1875075637716992:12345-192.168.204.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788211690.617293:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788211690.617325:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788211690.617331:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788211690.617335:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788211690.617338:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788211690.619910:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:8140:x1875075637716992:12345-192.168.204.29@tcp:256:mount.lustre.0 Request processed in 2644us (3061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211690.619927:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 214 00000100:00100000:2.0:1788211690.626252:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211690.626386:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637717120 00000100:00100000:0.0:1788211690.626396:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637717120 00000100:00100000:0.0:1788211690.626508:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 215 00000100:00100000:0.0:1788211690.626519:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:8140:x1875075637717120:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788211690.626536:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211690.626554:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a55cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f578d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211690.626586:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a55cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f578d expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211690.626597:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a55cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f578d expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211690.626620:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030600, rc 0) 00000100:00100000:0.0:1788211690.626690:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:8140:x1875075637717120:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 165us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211690.626698:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 215 00000100:00100000:3.0:1788211690.631981:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211690.632426:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637717248 00000100:00100000:0.0:1788211690.632450:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637717248 00000100:00100000:0.0:1788211690.632520:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 216 00000100:00100000:0.0:1788211690.632533:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:8140:x1875075637717248:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788211690.632904:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:8140:x1875075637717248:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 373us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211690.632915:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 216 00000100:00100000:3.0:1788211690.640634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211690.641043:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637717376 00000100:00100000:0.0:1788211690.641055:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637717376 00000100:00100000:0.0:1788211690.641125:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 217 00000100:00100000:0.0:1788211690.641135:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:8140:x1875075637717376:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788211690.641743:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:8140:x1875075637717376:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 595us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211690.641752:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 217 00000100:00100000:2.0:1788211690.644266:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211690.646307:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637717504 00000100:00100000:1.0:1788211690.646323:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637717504 00000100:00100000:1.0:1788211690.646392:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 218 00000100:00100000:1.0:1788211690.646402:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:8148:x1875075637717504:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788211690.646929:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:8148:x1875075637717504:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 524us (2667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211690.646939:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 218 00000100:00100000:3.0:1788211690.653602:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211690.653746:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637717632 00000100:00100000:2.0:1788211690.653761:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637717632 00000100:00100000:2.0:1788211690.653848:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 219 00000100:00100000:2.0:1788211690.653861:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:8148:x1875075637717632:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788211690.654278:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:8148:x1875075637717632:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 418us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211690.654287:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 219 00010000:00010000:0.0:1788211690.663401:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211690.681807:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211690.681867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211690.681991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211690.682060:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637718016 00000100:00100000:1.0:1788211690.682077:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637718016 00000100:00100000:1.0:1788211690.682153:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 220 00000100:00100000:1.0:1788211690.682205:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2358:x1875075637718016:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211690.682324:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2358:x1875075637718016:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 156us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211690.682356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 220 00000100:00100000:0.0:1788211690.699105:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637717760 00000100:00100000:0.0:1788211690.699121:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637717760 00000100:00100000:0.0:1788211690.700015:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637718144 00000100:00100000:0.0:1788211690.700025:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637718144 00000100:00100000:0.0:1788211690.700083:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:0.0:1788211690.700095:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637718144:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211690.700235:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637718144:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 142us (18243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211690.700243:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:0.0:1788211690.700263:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:0.0:1788211690.700268:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1875075637717760:12345-192.168.204.29@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788211690.700296:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cd57119c-37bb-4375-96c6-4462114b4b2c@192.168.204.29@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:0.0:1788211690.700344:0:5845:0:(genops.c:1385:class_connect()) connect: client cd57119c-37bb-4375-96c6-4462114b4b2c, cookie 0x2afbce82f55a55d2 00000004:00100000:0.0:1788211690.700389:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788211690.700743:0:5845:0:(import.c:65:import_set_state_nolock()) ffff8abfca9e6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788211690.700782:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+6:2357:x1875075637717760:12345-192.168.204.29@tcp:38:mount.lustre.0 Request processed in 512us (18914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211690.700790:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:2.0:1788211690.713010:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211690.713057:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211690.713221:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637717888 00000100:00100000:0.0:1788211690.713234:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637717888 00000100:00100000:0.0:1788211690.713333:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637718272 00000100:00100000:0.0:1788211690.713337:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637718272 00000100:00100000:0.0:1788211690.713366:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:0.0:1788211690.713380:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+7:0:x1875075637717888:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788211690.713447:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788211690.713554:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+7:0:x1875075637717888:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 176us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211690.713562:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:0.0:1788211690.713581:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:0.0:1788211690.713588:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+6:8140:x1875075637718272:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788211690.713623:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788211690.713646:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+6:8140:x1875075637718272:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 58us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211690.713652:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00080000:2.0:1788211690.713869:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211690.721612:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211690.722087:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637718400 00000100:00100000:2.0:1788211690.722100:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637718400 00000100:00100000:2.0:1788211690.722213:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:2.0:1788211690.722223:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+6:8140:x1875075637718400:12345-192.168.204.29@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788211690.722658:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+6:8140:x1875075637718400:12345-192.168.204.29@tcp:40:mount.lustre.0 Request processed in 435us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211690.722667:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:3.0:1788211690.724712:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211690.729798:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637718784 00000100:00100000:1.0:1788211690.729815:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637718784 00000100:00100000:1.0:1788211690.729897:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:1.0:1788211690.729909:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+6:8140:x1875075637718784:12345-192.168.204.29@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788211690.730349:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788211690.730611:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+6:8140:x1875075637718784:12345-192.168.204.29@tcp:33:mount.lustre.0 Request processed in 703us (5909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211690.730642:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:2.0:1788211690.735697:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211690.735841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211690.736061:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637718528 00000100:00100000:3.0:1788211690.736073:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637718528 00000100:00100000:3.0:1788211690.736127:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637718656 00000100:00100000:3.0:1788211690.736131:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637718656 00000100:00100000:3.0:1788211690.736153:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:3.0:1788211690.736162:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875075637718528:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788211690.736235:0:8290:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cd57119c-37bb-4375-96c6-4462114b4b2c@192.168.204.29@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:3.0:1788211690.736267:0:8290:0:(genops.c:1385:class_connect()) connect: client cd57119c-37bb-4375-96c6-4462114b4b2c, cookie 0x2afbce82f55a55d9 00002000:00100000:3.0:1788211690.736280:0:8290:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cd57119c-37bb-4375-96c6-4462114b4b2c/ffff8abec5adf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788211690.736310:0:8290:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788211690.737289:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:1.0:1788211690.737303:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875075637718656:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788211690.737334:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cd57119c-37bb-4375-96c6-4462114b4b2c@192.168.204.29@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:1.0:1788211690.737362:0:6696:0:(genops.c:1385:class_connect()) connect: client cd57119c-37bb-4375-96c6-4462114b4b2c, cookie 0x2afbce82f55a55e0 00002000:00100000:1.0:1788211690.737372:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cd57119c-37bb-4375-96c6-4462114b4b2c/ffff8abec5849000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788211690.737381:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788211690.737570:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788211690.737605:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8abec584b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788211690.737686:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+6:2357:x1875075637718656:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 383us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211690.737694:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00002000:00080000:2.0:1788211690.740694:0:8290:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788211690.740766:0:8290:0:(import.c:65:import_set_state_nolock()) ffff8abfd87cd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211690.740970:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+6:2357:x1875075637718528:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 4804us (5286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211690.740984:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00010000:00010000:2.0:1788211691.685637:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211692.714227:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788211693.405984:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cd57119c-37bb-4375-96c6-4462114b4b2c 00000001:00100000:2.0:1788211693.440337:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cd57119c-37bb-4375-96c6-4462114b4b2c 00010000:00010000:0.0:1788211693.735586:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211694.310000:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788211694.310028:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660820480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211694.310103:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211694.310961:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660820480 00000100:00100000:2.0:1788211694.310970:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660820480 00000100:00100000:2.0:1788211694.311042:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788211694.311053:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660820480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788211694.311098:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211694.311162:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660820480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211694.311189:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788211694.311234:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffdc7c000 x1875075660820480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211694.311252:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660820480:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788211694.311320:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788211694.757856:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211694.821630:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660820608:0@lo:400:kworker.0 00000100:00100000:1.0:1788211694.821661:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660820864:0@lo:400:kworker.0 00000100:00100000:0.0:1788211694.821715:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660820736:0@lo:400:kworker.0 00000100:00100000:3.0:1788211694.821729:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660820992:0@lo:400:kworker.0 00000100:00100000:1.0:1788211694.825273:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211694.825424:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660820864 00000100:00100000:1.0:1788211694.825434:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660820864 00000100:00100000:1.0:1788211694.825494:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788211694.825504:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660820864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211694.825560:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660820864:12345-0@lo:400:kworker.0 Request processed in 59us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211694.825567:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788211694.825614:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660820864:0@lo:400:kworker.0 00000100:00080000:1.0:1788211694.825641:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211694.831428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211694.831499:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660821248:0@lo:400:kworker.0 00000100:00100000:0.0:1788211694.831534:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211694.831816:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211694.831868:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660821120:0@lo:400:kworker.0 00000100:00100000:2.0:1788211694.831895:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211694.832035:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660820608 00000100:00100000:0.0:1788211694.832044:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660820608 00000100:00100000:0.0:1788211694.832096:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788211694.832106:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660820608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211694.832163:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660820608:12345-0@lo:400:kworker.0 Request processed in 58us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211694.832190:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788211694.832600:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660820736 00000100:00100000:0.0:1788211694.832606:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660820736 00000100:00100000:0.0:1788211694.832634:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660821120 00000100:00100000:0.0:1788211694.832637:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660821120 00000100:00100000:0.0:1788211694.832678:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788211694.832685:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660820736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211694.832732:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660820736:12345-0@lo:400:kworker.0 Request processed in 48us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211694.832738:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788211694.832749:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788211694.832772:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660821120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211694.832798:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660821120:12345-0@lo:400:kworker.0 Request processed in 28us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211694.832804:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788211694.832844:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660820736:0@lo:400:kworker.0 00000100:00100000:2.0:1788211694.832976:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660821120:0@lo:400:kworker.0 00000100:00100000:2.0:1788211694.832986:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660820608:0@lo:400:kworker.0 00000100:00100000:1.0:1788211694.835210:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660821248 00000100:00100000:1.0:1788211694.835224:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660821248 00000100:00100000:1.0:1788211694.835288:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788211694.835299:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660821248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211694.835411:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660821248:12345-0@lo:400:kworker.0 Request processed in 114us (3874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211694.835420:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788211694.835444:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211694.835449:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788211694.835488:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec665c380 x1875075660821248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211694.835504:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660821248:0@lo:400:kworker.0 00000100:00100000:3.0:1788211694.836200:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211694.841228:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660820992 00000100:00100000:0.0:1788211694.841247:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660820992 00000100:00100000:0.0:1788211694.841410:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788211694.841422:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660820992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211694.841537:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660820992:12345-0@lo:400:kworker.0 Request processed in 117us (5339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211694.841545:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788211694.841657:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec665ca80 x1875075660820992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211694.841675:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660820992:0@lo:400:kworker.0 00000100:00100000:0.0:1788211695.333530:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211695.333560:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660821376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788211695.333650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211695.333810:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660821376 00000100:00100000:3.0:1788211695.333820:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660821376 00000100:00100000:3.0:1788211695.333887:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788211695.333897:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660821376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211695.333952:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211695.336261:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660821376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2356us (2603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211695.336277:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788211695.341821:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffde65180 x1875075660821376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211695.341850:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660821376:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788211695.421847:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cd57119c-37bb-4375-96c6-4462114b4b2c 00010000:00010000:0.0:1788211695.783384:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211695.837697:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211695.837755:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211695.837980:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637718912 00000100:00100000:0.0:1788211695.837993:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637718912 00000100:00100000:0.0:1788211695.838071:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 222 00000100:00100000:0.0:1788211695.838084:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637718912:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211695.838186:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637718912:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 83us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211695.838214:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 222 00000100:00100000:2.0:1788211695.838549:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211695.838603:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211695.838651:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211695.839125:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637719168 00000100:00100000:0.0:1788211695.839131:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637719168 00000100:00100000:0.0:1788211695.839209:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637719040 00000100:00100000:0.0:1788211695.839212:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637719040 00000100:00100000:0.0:1788211695.839232:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:0.0:1788211695.839240:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637719168:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211695.839288:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637719168:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 49us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211695.839295:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:0.0:1788211695.839308:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 74 00000100:00100000:0.0:1788211695.839314:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637719040:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211695.839340:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637719040:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211695.839346:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 74 00000100:00100000:0.0:1788211695.839364:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637719424 00000100:00100000:0.0:1788211695.839367:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637719424 00000100:00100000:0.0:1788211695.839393:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637719296 00000100:00100000:0.0:1788211695.839396:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637719296 00000100:00100000:0.0:1788211695.839416:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:0.0:1788211695.839422:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637719424:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211695.839450:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637719424:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211695.839455:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:0.0:1788211695.839465:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:0.0:1788211695.839482:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637719296:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211695.839509:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637719296:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211695.839514:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00080000:2.0:1788211695.840202:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788211695.840208:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788211695.840220:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788211696.808508:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788211697.203565:0:10324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788211697.829473:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211698.857360:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211699.430630:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660821504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788211699.430742:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211699.430835:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660821504 00000100:00100000:2.0:1788211699.430845:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660821504 00000100:00100000:2.0:1788211699.430942:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788211699.430953:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660821504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788211699.431006:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211699.431065:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660821504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211699.431073:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788211699.431098:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788211699.431145:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffdc7ea00 x1875075660821504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211699.431200:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660821504:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788211699.877999:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211699.944870:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788211699.945009:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660821760:0@lo:400:kworker.0 00000100:00100000:2.0:1788211699.945084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211699.945161:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211699.945188:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660821888:0@lo:400:kworker.0 00000100:00100000:2.0:1788211699.945231:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211699.945279:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660821760 00000100:00100000:2.0:1788211699.945290:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660821760 00000100:00100000:2.0:1788211699.945345:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660821888 00000100:00100000:2.0:1788211699.945348:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660821888 00000100:00100000:2.0:1788211699.945385:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788211699.945393:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660821760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211699.945456:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660821760:12345-0@lo:400:kworker.0 Request processed in 63us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211699.945465:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788211699.945500:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788211699.945508:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660821888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211699.945537:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660821888:12345-0@lo:400:kworker.0 Request processed in 30us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211699.945543:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788211699.945574:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211699.945612:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660821888:0@lo:400:kworker.0 00000100:00100000:2.0:1788211699.945625:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660821760:0@lo:400:kworker.0 00000100:00100000:3.0:1788211699.950350:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660822016:0@lo:400:kworker.0 00000100:00100000:3.0:1788211699.950431:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211699.950491:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660821632:0@lo:400:kworker.0 00000100:00100000:3.0:1788211699.950521:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211699.950663:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660822016 00000100:00100000:3.0:1788211699.950671:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660822016 00000100:00100000:3.0:1788211699.950724:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788211699.950734:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660822016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211699.950794:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660822016:12345-0@lo:400:kworker.0 Request processed in 60us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211699.950803:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788211699.950834:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660821632 00000100:00100000:3.0:1788211699.950838:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660821632 00000100:00100000:3.0:1788211699.950868:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788211699.950876:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660821632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211699.950913:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660821632:12345-0@lo:400:kworker.0 Request processed in 39us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211699.950920:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00080000:3.0:1788211699.951540:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001367480 x1875075660822016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211699.951568:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660822016:0@lo:400:kworker.0 00000100:00100000:3.0:1788211699.951581:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660821632:0@lo:400:kworker.0 00000100:00100000:0.0:1788211699.952220:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660822144:0@lo:400:kworker.0 00000100:00100000:0.0:1788211699.952268:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211699.952304:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660822272:0@lo:400:kworker.0 00000100:00100000:0.0:1788211699.952330:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211699.952359:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660822272 00000100:00100000:0.0:1788211699.952364:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660822272 00000100:00100000:0.0:1788211699.952410:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788211699.952418:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660822272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211699.952462:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660822272:12345-0@lo:400:kworker.0 Request processed in 45us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211699.952469:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788211699.952749:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788211699.952781:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001367480 x1875075660822272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211699.952793:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660822272:0@lo:400:kworker.0 00000100:00100000:3.0:1788211699.952942:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660822144 00000100:00100000:3.0:1788211699.953257:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660822144 00000100:00100000:3.0:1788211699.953324:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788211699.953332:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660822144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211699.953385:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660822144:12345-0@lo:400:kworker.0 Request processed in 54us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211699.953392:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788211699.953424:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660822144:0@lo:400:kworker.0 00000100:00080000:0.0:1788211699.953478:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211700.453718:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660822400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788211700.453795:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211700.453972:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660822400 00000100:00100000:3.0:1788211700.453981:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660822400 00000100:00100000:3.0:1788211700.454047:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788211700.454061:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660822400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211700.454119:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211700.454191:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660822400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211700.454200:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788211700.455348:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca879880 x1875075660822400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211700.455395:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660822400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788211700.902725:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211700.961238:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211700.961386:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211700.961424:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211700.961445:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211700.961473:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211700.961746:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637719808 00000100:00100000:3.0:1788211700.961759:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637719808 00000100:00100000:3.0:1788211700.961832:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637719680 00000100:00100000:3.0:1788211700.961835:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637719680 00000100:00100000:3.0:1788211700.961859:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:3.0:1788211700.961871:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637719808:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211700.961976:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637719808:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 108us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211700.961985:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:3.0:1788211700.962004:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:3.0:1788211700.962011:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637719680:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211700.962061:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637719680:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 50us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211700.962068:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:3.0:1788211700.962291:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637720064 00000100:00100000:3.0:1788211700.962296:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637720064 00000100:00100000:3.0:1788211700.962323:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637719936 00000100:00100000:3.0:1788211700.962326:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637719936 00000100:00100000:3.0:1788211700.962357:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:3.0:1788211700.962363:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637720064:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211700.962391:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637720064:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211700.962397:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:3.0:1788211700.962408:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:3.0:1788211700.962414:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637719936:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211700.962436:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637719936:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 23us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211700.962442:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00080000:0.0:1788211700.964203:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788211700.964218:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788211700.964221:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211700.967200:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637719552 00000100:00100000:2.0:1788211700.967219:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637719552 00000100:00100000:2.0:1788211700.967300:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 224 00000100:00100000:2.0:1788211700.967311:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2358:x1875075637719552:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211700.967829:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2358:x1875075637719552:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 517us (6602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211700.967840:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 224 00010000:00010000:2.0:1788211701.925426:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211702.952105:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211703.974070:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211704.553661:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788211704.553686:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660822528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211704.553759:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211704.553823:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660822528 00000100:00100000:3.0:1788211704.553832:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660822528 00000100:00100000:3.0:1788211704.553898:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788211704.553909:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660822528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788211704.553953:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211704.554011:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660822528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211704.554019:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788211704.554040:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788211704.554070:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffdc7f100 x1875075660822528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211704.554090:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660822528:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788211705.000368:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211705.069669:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660823040:0@lo:400:kworker.0 00000100:00100000:2.0:1788211705.069786:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211705.069800:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660822784:0@lo:400:kworker.0 00000100:00100000:0.0:1788211705.069841:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211705.069874:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660823296:0@lo:400:kworker.0 00000100:00100000:0.0:1788211705.069897:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211705.069921:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211705.069926:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660822912:0@lo:400:kworker.0 00000100:00100000:2.0:1788211705.069931:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788211705.069942:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660822656:0@lo:400:kworker.0 00000100:00100000:0.0:1788211705.069947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211705.069982:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660822784 00000100:00100000:2.0:1788211705.069989:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211705.069990:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660822784 00000100:00100000:0.0:1788211705.070032:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660822912 00000100:00100000:0.0:1788211705.070034:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660822912 00000100:00100000:0.0:1788211705.070065:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788211705.070077:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660822784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211705.070084:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660823168:0@lo:400:kworker.0 00000100:00100000:2.0:1788211705.070113:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211705.070140:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660822784:12345-0@lo:400:kworker.0 Request processed in 64us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211705.070149:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788211705.070150:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660823040 00000100:00100000:2.0:1788211705.070155:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660823040 00000100:00100000:0.0:1788211705.070198:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660823168 00000100:00100000:0.0:1788211705.070203:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660823168 00000100:00100000:2.0:1788211705.070214:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660823296 00000100:00100000:2.0:1788211705.070219:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660823296 00000100:00100000:2.0:1788211705.070249:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788211705.070256:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660823040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211705.070369:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660823040:12345-0@lo:400:kworker.0 Request processed in 113us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211705.070377:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788211705.070391:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788211705.070397:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660823296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211705.070423:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660823296:12345-0@lo:400:kworker.0 Request processed in 27us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211705.070430:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788211705.070458:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660822656 00000100:00100000:2.0:1788211705.070462:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660822656 00000100:00100000:2.0:1788211705.070490:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788211705.070498:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660822656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211705.070530:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660822656:12345-0@lo:400:kworker.0 Request processed in 34us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211705.070536:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788211705.070584:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788211705.070593:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788211705.070594:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660822912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211705.070607:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660823168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211705.070651:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660822912:12345-0@lo:400:kworker.0 Request processed in 58us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211705.070658:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788211705.070662:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660823168:12345-0@lo:400:kworker.0 Request processed in 57us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211705.070672:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788211705.070706:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788211705.070711:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660822656:0@lo:400:kworker.0 00000100:00080000:0.0:1788211705.070711:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211705.070730:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660823168:0@lo:400:kworker.0 00000100:00100000:0.0:1788211705.070740:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660822912:0@lo:400:kworker.0 00010000:00080000:2.0:1788211705.070748:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca87aa00 x1875075660823040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211705.070756:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660822784:0@lo:400:kworker.0 00000100:00100000:2.0:1788211705.070764:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660823040:0@lo:400:kworker.0 00010000:00080000:0.0:1788211705.070770:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca87b100 x1875075660823296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211705.070782:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660823296:0@lo:400:kworker.0 00000100:00100000:0.0:1788211705.578692:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660823424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788211705.578772:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211705.579809:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660823424 00000100:00100000:3.0:1788211705.579823:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660823424 00000100:00100000:3.0:1788211705.579924:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788211705.579948:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660823424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211705.579998:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211705.580086:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660823424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211705.580094:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788211705.581024:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca87aa00 x1875075660823424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211705.581057:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660823424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788211706.021648:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211706.074224:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211706.074259:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211706.074291:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211706.074313:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211706.074335:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211706.074379:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637720704 00000100:00100000:0.0:1788211706.074390:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637720704 00000100:00100000:0.0:1788211706.074455:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637720576 00000100:00100000:0.0:1788211706.074459:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637720576 00000100:00100000:0.0:1788211706.074485:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:0.0:1788211706.074497:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff7080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2360:x1875075637720704:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211706.074568:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff7080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2360:x1875075637720704:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 73us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211706.074576:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:0.0:1788211706.074742:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:0.0:1788211706.074750:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2360:x1875075637720576:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211706.074776:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2360:x1875075637720576:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211706.074783:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:0.0:1788211706.074803:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637720448 00000100:00100000:0.0:1788211706.074807:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637720448 00000100:00100000:0.0:1788211706.074833:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637720320 00000100:00100000:0.0:1788211706.074836:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637720320 00000100:00100000:2.0:1788211706.075108:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637720192 00000100:00100000:2.0:1788211706.075113:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637720192 00000100:00100000:2.0:1788211706.075141:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 226 00000100:00100000:2.0:1788211706.075147:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2360:x1875075637720192:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211706.075193:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2360:x1875075637720192:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 46us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211706.075199:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 226 00000100:00100000:0.0:1788211706.075290:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:0.0:1788211706.075297:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2360:x1875075637720448:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211706.075325:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2360:x1875075637720448:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 29us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211706.075330:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:0.0:1788211706.075343:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:0.0:1788211706.075350:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637720320:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211706.075369:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637720320:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 21us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211706.075380:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00080000:0.0:1788211706.077707:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788211706.077718:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788211706.077722:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788211707.045610:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211708.083007:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211709.093470:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211709.689628:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788211709.694840:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660823552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211709.694926:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211709.695102:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660823552 00000100:00100000:3.0:1788211709.695111:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660823552 00000100:00100000:3.0:1788211709.695210:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788211709.695221:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660823552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788211709.695269:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211709.695317:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660823552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211709.695324:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788211709.695620:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788211709.695750:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec665e680 x1875075660823552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211709.695787:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660823552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788211710.118692:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211710.183862:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660823808:0@lo:400:kworker.0 00000100:00100000:1.0:1788211710.183954:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211710.184009:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660824320:0@lo:400:kworker.0 00000100:00100000:1.0:1788211710.184037:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211710.184071:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211710.184078:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660823936:0@lo:400:kworker.0 00000100:00100000:1.0:1788211710.184100:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211710.184133:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660823808 00000100:00100000:1.0:1788211710.184141:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660823808 00000100:00100000:1.0:1788211710.184231:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660823936 00000100:00100000:1.0:1788211710.184235:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660823936 00000100:00100000:1.0:1788211710.184271:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788211710.184281:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660823808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211710.184340:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660823808:12345-0@lo:400:kworker.0 Request processed in 60us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211710.184359:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788211710.184378:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788211710.184385:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660823936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211710.184412:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660823936:12345-0@lo:400:kworker.0 Request processed in 28us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211710.184418:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788211710.184438:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660824320 00000100:00100000:1.0:1788211710.184441:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660824320 00000100:00100000:1.0:1788211710.184471:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788211710.184478:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660824320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211710.184508:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660824320:12345-0@lo:400:kworker.0 Request processed in 32us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211710.184514:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788211710.184551:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211710.184555:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211710.184586:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660823936:0@lo:400:kworker.0 00000100:00100000:1.0:1788211710.184596:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660823808:0@lo:400:kworker.0 00010000:00080000:1.0:1788211710.184606:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec665c380 x1875075660824320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211710.184616:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660824320:0@lo:400:kworker.0 00000100:00100000:2.0:1788211710.184824:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660823680:0@lo:400:kworker.0 00000100:00100000:2.0:1788211710.184860:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211710.184887:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660824192:0@lo:400:kworker.0 00000100:00100000:2.0:1788211710.184908:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211710.184926:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788211710.184931:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660824064:0@lo:400:kworker.0 00000100:00100000:2.0:1788211710.184952:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211710.185000:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660823680 00000100:00100000:2.0:1788211710.185004:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660823680 00000100:00100000:2.0:1788211710.185031:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788211710.185037:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660823680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211710.185070:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660823680:12345-0@lo:400:kworker.0 Request processed in 33us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211710.185076:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788211710.185100:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660824192 00000100:00100000:2.0:1788211710.185104:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660824192 00000100:00100000:2.0:1788211710.185130:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788211710.185136:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660824192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211710.185185:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660824192:12345-0@lo:400:kworker.0 Request processed in 28us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211710.185193:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788211710.185209:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660824064 00000100:00100000:2.0:1788211710.185213:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660824064 00000100:00100000:2.0:1788211710.185235:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788211710.185240:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660824064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211710.185269:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660824064:12345-0@lo:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211710.185275:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788211710.185302:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788211710.185319:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec665ed80 x1875075660824064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211710.185329:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660824064:0@lo:400:kworker.0 00000100:00100000:2.0:1788211710.185338:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660823680:0@lo:400:kworker.0 00000100:00100000:2.0:1788211710.185372:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660824192:0@lo:400:kworker.0 00000100:00100000:2.0:1788211710.693389:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211710.693411:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660824448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211710.693480:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211710.693591:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660824448 00000100:00100000:0.0:1788211710.693600:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660824448 00000100:00100000:0.0:1788211710.693659:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788211710.693669:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660824448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788211710.693722:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211710.693927:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660824448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 258us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211710.693934:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788211710.693999:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca879500 x1875075660824448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211710.694029:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660824448:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788211711.145089:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211711.196074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211711.196132:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211711.196200:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211711.196232:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637721088 00000100:00100000:3.0:1788211711.196253:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637721088 00000100:00100000:3.0:1788211711.196314:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637720960 00000100:00100000:3.0:1788211711.196317:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637720960 00000100:00100000:3.0:1788211711.196355:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:3.0:1788211711.196365:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2359:x1875075637721088:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211711.196452:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2359:x1875075637721088:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 88us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211711.196459:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:3.0:1788211711.196477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 89 00000100:00100000:3.0:1788211711.196484:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637720960:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211711.196505:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637720960:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 22us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211711.196511:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 89 00000100:00080000:3.0:1788211711.196526:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211711.197570:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637720832 00000100:00100000:0.0:1788211711.197590:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637720832 00000100:00100000:0.0:1788211711.197656:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 228 00000100:00100000:0.0:1788211711.197664:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637720832:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211711.197714:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637720832:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 52us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211711.197745:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 228 00000100:00100000:0.0:1788211711.200925:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211711.201000:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211711.203926:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637721216 00000100:00100000:1.0:1788211711.203941:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637721216 00000100:00100000:1.0:1788211711.204014:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637721344 00000100:00100000:1.0:1788211711.204018:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637721344 00000100:00100000:1.0:1788211711.204045:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:1.0:1788211711.204055:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2357:x1875075637721216:12345-192.168.204.29@tcp:9:kworker.0 00000100:00080000:2.0:1788211711.204159:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788211711.204183:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788211711.204221:0:8290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a55d9 00000100:00080000:1.0:1788211711.204233:0:8290:0:(import.c:65:import_set_state_nolock()) ffff8abfd87cd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788211711.204299:0:8290:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1788211711.204524:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211711.206341:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:1.0:1788211711.206376:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2357:x1875075637721344:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:1.0:1788211711.207002:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a55e0 00000100:00080000:1.0:1788211711.207014:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8abec584b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788211711.207119:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788211711.208988:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+2:2357:x1875075637721344:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 2620us (7979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211711.209002:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:1.0:1788211711.209135:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+2:2357:x1875075637721216:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 5081us (8219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211711.209158:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00010000:00010000:2.0:1788211711.215962:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211712.169871:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211713.191978:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788211713.866660:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cd57119c-37bb-4375-96c6-4462114b4b2c 00000020:00000080:1.0:1788211713.866672:0:7655:0:(genops.c:885:class_export_put()) final put ffff8abec5849000/cd57119c-37bb-4375-96c6-4462114b4b2c 00000020:00000080:3.0:1788211713.871498:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec5849000/cd57119c-37bb-4375-96c6-4462114b4b2c for lustre-OST0001 00000020:00000080:3.0:1788211713.871596:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec584b000 for lustre-OST0001 00010000:00010000:1.0:1788211714.213482:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211714.789777:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660824576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211714.789885:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211714.790457:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660824576 00000100:00100000:1.0:1788211714.790468:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660824576 00000100:00100000:1.0:1788211714.790569:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788211714.790581:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660824576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788211714.790634:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211714.790835:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660824576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 255us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211714.790844:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788211714.790965:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788211714.791005:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec665c380 x1875075660824576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211714.791027:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660824576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788211715.238307:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211715.316341:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660824704:0@lo:400:kworker.0 00000100:00100000:3.0:1788211715.316422:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211715.316487:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660825216:0@lo:400:kworker.0 00000100:00100000:3.0:1788211715.316515:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211715.316545:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788211715.316551:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660825088:0@lo:400:kworker.0 00000100:00100000:3.0:1788211715.316577:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211715.316608:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660824704 00000100:00100000:3.0:1788211715.316615:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660824704 00000100:00100000:3.0:1788211715.316663:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788211715.316819:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660824704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211715.316876:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660824704:12345-0@lo:400:kworker.0 Request processed in 129us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211715.316884:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788211715.316919:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660825088 00000100:00100000:3.0:1788211715.316923:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660825088 00000100:00100000:0.0:1788211715.317241:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660824832:0@lo:400:kworker.0 00000100:00100000:0.0:1788211715.317288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211715.317315:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211715.317320:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660824960:0@lo:400:kworker.0 00000100:00100000:0.0:1788211715.317340:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211715.317371:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660825216 00000100:00100000:0.0:1788211715.317374:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660825216 00000100:00100000:0.0:1788211715.317411:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788211715.317419:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660825216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211715.317455:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660825216:12345-0@lo:400:kworker.0 Request processed in 37us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211715.317461:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788211715.317482:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660824832 00000100:00100000:0.0:1788211715.317486:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660824832 00000100:00100000:3.0:1788211715.318056:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660824960 00000100:00100000:3.0:1788211715.318062:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660824960 00000100:00100000:0.0:1788211715.318111:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788211715.318119:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660825088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211715.318189:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660825088:12345-0@lo:400:kworker.0 Request processed in 71us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211715.318196:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788211715.318210:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788211715.318318:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788211715.318327:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660824960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211715.318366:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660824960:12345-0@lo:400:kworker.0 Request processed in 42us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211715.318373:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788211715.318417:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660825088:0@lo:400:kworker.0 00000100:00100000:3.0:1788211715.318429:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660824704:0@lo:400:kworker.0 00010000:00080000:3.0:1788211715.318443:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca879c00 x1875075660825216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211715.318454:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660825216:0@lo:400:kworker.0 00000100:00080000:3.0:1788211715.318496:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788211715.318501:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211715.318926:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660824832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211715.318982:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660824832:12345-0@lo:400:kworker.0 Request processed in 63us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211715.318997:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788211715.319052:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660824960:0@lo:400:kworker.0 00000100:00100000:0.0:1788211715.319064:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660824832:0@lo:400:kworker.0 00000100:00100000:2.0:1788211715.821306:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660825344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211715.821413:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211715.821502:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660825344 00000100:00100000:2.0:1788211715.821509:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660825344 00000100:00100000:2.0:1788211715.821563:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788211715.821573:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660825344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211715.821615:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211715.821684:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660825344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211715.821692:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788211715.821732:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca878700 x1875075660825344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211715.821753:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660825344:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788211715.926642:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cd57119c-37bb-4375-96c6-4462114b4b2c 00000020:00000080:3.0:1788211715.926660:0:6720:0:(genops.c:885:class_export_put()) final put ffff8abec5adf000/cd57119c-37bb-4375-96c6-4462114b4b2c 00000020:00000080:0.0:1788211715.926812:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec5adf000/cd57119c-37bb-4375-96c6-4462114b4b2c for lustre-OST0000 00000020:00000080:0.0:1788211715.926870:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfd87cd800 for lustre-OST0000 00010000:00010000:1.0:1788211716.261834:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211716.313731:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211716.313772:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211716.313812:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211716.313840:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637721472 00000100:00100000:3.0:1788211716.313852:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637721472 00000100:00100000:0.0:1788211716.313860:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637721728 00000100:00100000:0.0:1788211716.313866:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637721728 00000100:00100000:1.0:1788211716.313874:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637721600 00000100:00100000:1.0:1788211716.313878:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637721600 00000100:00100000:3.0:1788211716.313915:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 230 00000100:00100000:0.0:1788211716.313922:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 93 00000100:00100000:3.0:1788211716.313928:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637721472:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211716.313936:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637721728:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211716.314006:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637721472:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 81us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211716.314014:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 230 00000100:00080000:3.0:1788211716.314044:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211716.314142:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637721728:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 210us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211716.314150:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 93 00000100:00100000:1.0:1788211716.316031:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 94 00000100:00100000:1.0:1788211716.316073:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637721600:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211716.316160:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637721600:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 117us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211716.316185:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 94 00000001:02000400:0.0:1788211717.168343:0:11027:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788211717.292977:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211718.314345:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211719.333710:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211719.914773:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660825472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211719.914858:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211719.915010:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660825472 00000100:00100000:1.0:1788211719.915018:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660825472 00000100:00100000:1.0:1788211719.915138:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788211719.915149:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660825472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788211719.915240:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211719.915326:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660825472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211719.915334:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788211719.915473:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec665c700 x1875075660825472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211719.915502:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660825472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788211719.920926:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788211720.362832:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211720.421580:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660825856:0@lo:400:kworker.0 00000100:00100000:2.0:1788211720.421683:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211720.421784:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211720.421790:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660825984:0@lo:400:kworker.0 00000100:00100000:2.0:1788211720.421813:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211720.421859:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660825856 00000100:00100000:2.0:1788211720.421871:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660825856 00000100:00100000:2.0:1788211720.421937:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660825984 00000100:00100000:2.0:1788211720.421941:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660825984 00000100:00100000:2.0:1788211720.421968:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788211720.421978:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660825856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211720.422039:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660825856:12345-0@lo:400:kworker.0 Request processed in 62us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211720.422068:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788211720.422088:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788211720.422096:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660825984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211720.422124:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660825984:12345-0@lo:400:kworker.0 Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211720.422129:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1788211720.422193:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211720.422241:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660825984:0@lo:400:kworker.0 00000100:00100000:2.0:1788211720.422252:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660825856:0@lo:400:kworker.0 00000100:00100000:3.0:1788211720.422353:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660825728:0@lo:400:kworker.0 00000100:00100000:3.0:1788211720.422384:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211720.422429:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788211720.422435:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660825600:0@lo:400:kworker.0 00000100:00100000:3.0:1788211720.422464:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211720.422484:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660826112:0@lo:400:kworker.0 00000100:00100000:3.0:1788211720.422512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211720.422560:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660826112 00000100:00100000:3.0:1788211720.422565:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660826112 00000100:00100000:3.0:1788211720.422607:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788211720.422614:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660826112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211720.422651:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660826112:12345-0@lo:400:kworker.0 Request processed in 37us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211720.422667:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788211720.422697:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca87bb80 x1875075660826112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211720.422707:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660826112:0@lo:400:kworker.0 00000100:00100000:0.0:1788211720.423732:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660825600 00000100:00100000:0.0:1788211720.423743:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660825600 00000100:00100000:2.0:1788211720.423955:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660825728 00000100:00100000:2.0:1788211720.423960:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660825728 00000100:00100000:2.0:1788211720.423998:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788211720.424005:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660825728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211720.424106:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660825728:12345-0@lo:400:kworker.0 Request processed in 101us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211720.424128:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1788211720.424161:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788211720.424225:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660825728:0@lo:400:kworker.0 00000100:00100000:0.0:1788211720.424318:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788211720.424332:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660825600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211720.424379:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660825600:12345-0@lo:400:kworker.0 Request processed in 48us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211720.424385:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788211720.424454:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660825600:0@lo:400:kworker.0 00000100:00100000:3.0:1788211720.933503:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660826240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211720.933604:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211720.934697:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660826240 00000100:00100000:2.0:1788211720.934717:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660826240 00000100:00100000:2.0:1788211720.934805:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788211720.934818:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660826240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211720.934868:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211720.934976:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660826240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211720.934985:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788211720.935207:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca878700 x1875075660826240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211720.935229:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660826240:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788211721.145577:0:11174:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2d64c800 20000000:00000080:1.0:1788211721.145597:0:11174:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ac00121b000 uarg=0000000000000000 20000000:01000000:1.0:1788211721.145639:0:11174:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788211721.145645:0:11174:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788211721.145650:0:11174:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788211721.146570:0:11175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788211721.146810:0:11174:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788211721.153357:0:11174:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788211721.153397:0:11174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.153425:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abffdb80200/0x2afbce82f55a558c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5755 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.153439:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a559a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5593 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.153447:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a55a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a55a1 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.153458:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a55b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a55af expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.153468:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a55cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f578d expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.153478:0:11174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.153552:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a55cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f578d expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.153569:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a55cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f578d expref: 12 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211721.153583:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875075660826368:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211721.153753:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a55b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a55af expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.153769:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a55b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a55af expref: 18 pid: 5836 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211721.153784:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875075660826496:0@lo:104: 00000100:00100000:1.0:1788211721.153889:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788211721.153988:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a55a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a55a1 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.154001:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a55a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a55a1 expref: 18 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211721.154015:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875075660826624:0@lo:104: 00000100:00100000:1.0:1788211721.154054:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211721.154367:0:8518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660826496 00000100:00100000:3.0:1788211721.154377:0:8518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660826496 00000100:00100000:3.0:1788211721.154437:0:8518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660826624 00000100:00100000:3.0:1788211721.154440:0:8518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660826624 00000100:00100000:3.0:1788211721.154458:0:8518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788211721.154468:0:8518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:afe7852e-b478-4e21-8864-7e739fb0a137+4:11174:x1875075660826496:12345-0@lo:104: 00010000:00010000:3.0:1788211721.154483:0:8518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a55b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.154541:0:8518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788211721.154548:0:8518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:afe7852e-b478-4e21-8864-7e739fb0a137+4:11174:x1875075660826496:12345-0@lo:104: Request processed in 82us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211721.154555:0:8518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788211721.154573:0:8518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788211721.154578:0:8518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:afe7852e-b478-4e21-8864-7e739fb0a137+3:11174:x1875075660826624:12345-0@lo:104: 00010000:00010000:3.0:1788211721.154586:0:8518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a55a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.154618:0:8518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788211721.154623:0:8518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:afe7852e-b478-4e21-8864-7e739fb0a137+3:11174:x1875075660826624:12345-0@lo:104: Request processed in 45us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211721.154640:0:8518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788211721.154677:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788211721.154683:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a55b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.154690:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0031a00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211721.154696:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a55b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.154704:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a55b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211721.154712:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a55b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211721.154718:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788211721.154749:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a55b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.154755:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211721.154771:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a55b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.154777:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a55b6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.154792:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211721.154795:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a55a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.154811:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062000 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211721.154813:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a55a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.154820:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a55a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211721.154826:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a55a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211721.154831:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788211721.154844:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a55a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.154850:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211721.154856:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a55a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.154863:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a55a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a55a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.154871:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211721.154873:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211721.154875:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211721.154881:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211721.154984:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660826752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788211721.155027:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211721.155072:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211721.155078:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660826880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788211721.155101:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211721.155131:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660826752 00000100:00100000:2.0:1788211721.155146:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660826752 00010000:00010000:2.0:1788211721.155186:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a55b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a55af expref: 19 pid: 5836 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211721.155215:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660826880 00000100:00100000:2.0:1788211721.155219:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660826880 00010000:00010000:2.0:1788211721.155231:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a55a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a55a1 expref: 20 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211721.155258:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788211721.155264:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+20:3308:x1875075660826752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788211721.155275:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211721.155281:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a55b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a55af expref: 20 pid: 5836 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211721.155290:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a55b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a55af expref: 20 pid: 5836 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211721.155307:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211721.155335:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+20:3308:x1875075660826752:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211721.155342:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788211721.155381:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788211721.155387:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660826880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788211721.155395:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211721.155399:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a55a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a55a1 expref: 19 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211721.155406:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a55a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a55a1 expref: 19 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211721.155415:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211721.155436:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660826880:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211721.155442:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788211721.155479:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660826880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788211721.155497:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660826752:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788211721.157061:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a559a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a5593 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.157079:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a559a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a5593 expref: 18 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211721.157117:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875075660827008:0@lo:104: 00000100:00100000:1.0:1788211721.157241:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788211721.157301:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abffdb80200/0x2afbce82f55a558c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5755 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.157381:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abffdb80200/0x2afbce82f55a558c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5755 expref: 12 pid: 5838 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211721.157393:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875075660827136:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211721.157457:0:11174:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec6752e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788211721.157482:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a55b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a55af expref: 18 pid: 5836 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211721.157496:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875075660826496:0@lo:104: 00010000:00010000:1.0:1788211721.157507:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a55a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a55a1 expref: 17 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211721.157515:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875075660826624:0@lo:104: 00000100:00100000:3.0:1788211721.157589:0:8518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660827008 00000100:00100000:3.0:1788211721.157596:0:8518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660827008 00000100:00100000:3.0:1788211721.157663:0:8518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788211721.157672:0:8518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:afe7852e-b478-4e21-8864-7e739fb0a137+3:11174:x1875075660827008:12345-0@lo:104: 00010000:00010000:3.0:1788211721.157692:0:8518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a559a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.157747:0:8518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788211721.157754:0:8518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:afe7852e-b478-4e21-8864-7e739fb0a137+3:11174:x1875075660827008:12345-0@lo:104: Request processed in 84us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211721.157762:0:8518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788211721.157783:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211721.157789:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a559a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.157796:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07200 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211721.157800:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a559a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.157808:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a559a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211721.157815:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a559a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211721.157820:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788211721.157848:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a559a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.157855:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211721.157876:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a559a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.157882:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07200/0x2afbce82f55a5593 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a559a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.157903:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211721.157904:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211721.157906:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211721.157919:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660827264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788211721.157949:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211721.158526:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875075660827008:0@lo:104: 00000100:00100000:3.0:1788211721.158959:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660827264 00000100:00100000:3.0:1788211721.158965:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660827264 00010000:00010000:3.0:1788211721.158993:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a559a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5593 expref: 17 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211721.159033:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788211721.159043:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+17:3310:x1875075660827264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211721.159056:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211721.159062:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a559a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a5593 expref: 17 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.159073:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a559a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a5593 expref: 17 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.159089:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a559a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a5593 expref: 17 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.159104:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211721.159158:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+16:3310:x1875075660827264:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211721.159186:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788211721.159219:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660827264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211721.161303:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211721.161344:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211721.161375:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637721856 00000100:00100000:0.0:1788211721.161384:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637721856 00010000:00010000:0.0:1788211721.161424:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a55cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f578d expref: 13 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211721.161455:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637721984 00000100:00100000:0.0:1788211721.161458:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637721984 00010000:00010000:0.0:1788211721.161471:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abffdb80200/0x2afbce82f55a558c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5755 expref: 14 pid: 5838 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211721.161485:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:0.0:1788211721.161494:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+14:2358:x1875075637721856:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211721.161510:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211721.161517:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a55cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f578d expref: 14 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.161530:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a55cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f578d expref: 14 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211721.161784:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875075660826368:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211721.161795:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1875075660827136:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211721.161889:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc0030600/0x2afbce82f55a55cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f578d expref: 14 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.166479:0:11174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.166550:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211721.166801:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2358:x1875075637721856:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5302us (5577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211721.166814:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:0.0:1788211721.166851:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:0.0:1788211721.166863:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:2358:x1875075637721984:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211721.166880:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211721.166887:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abffdb80200/0x2afbce82f55a558c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5755 expref: 12 pid: 5838 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.166899:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abffdb80200/0x2afbce82f55a558c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5755 expref: 12 pid: 5838 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.166923:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb80200/0x2afbce82f55a558c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5755 expref: 12 pid: 5838 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.166946:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.166960:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.166982:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.167021:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.167030:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.167041:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.167050:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211721.167056:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.167068:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.167103:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211721.167114:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211721.167228:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:2358:x1875075637721984:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 300us (5814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211721.167236:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 29 00010000:00010000:1.0:1788211721.167382:0:11174:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.167418:0:11174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211721.167429:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a55e7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211721.381702:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211721.434291:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211721.434328:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211721.436631:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637722112 00000100:00100000:1.0:1788211721.436651:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637722112 00000100:00100000:2.0:1788211721.437626:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637722240 00000100:00100000:2.0:1788211721.437635:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637722240 00000100:00100000:3.0:1788211721.440424:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 98 00000100:00100000:3.0:1788211721.440444:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637722112:12345-192.168.204.29@tcp:400:kworker.0 00000100:00080000:0.0:1788211721.440720:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211721.440880:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637722112:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 441us (6600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211721.440889:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 98 00000100:00100000:3.0:1788211721.441712:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 99 00000100:00100000:3.0:1788211721.441725:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2360:x1875075637722240:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211721.441799:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2360:x1875075637722240:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 77us (7469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211721.441807:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 99 00000100:00080000:2.0:1788211721.442087:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1788211722.279397:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788211722.279407:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfcaf32000 from 7 10000000:01000000:0.0:1788211722.279414:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788211722.279468:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211722.279490:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211722.279503:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211722.279537:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660827392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788211722.279616:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211722.279669:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211722.290489:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660827392 00000100:00100000:1.0:1788211722.290509:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660827392 00000100:00100000:1.0:1788211722.290608:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788211722.290621:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660827392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211722.290640:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211722.290666:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b07600/0x2afbce82f55a55f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a55ee expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.290698:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b07600/0x2afbce82f55a55f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a55ee expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.290710:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b07600/0x2afbce82f55a55f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a55ee expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.290719:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07600, rc 0) 00000100:00100000:1.0:1788211722.292416:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660827392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1788us (12790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211722.292429:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788211722.292523:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660827392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211722.292558:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a55f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.292583:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a55f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211722.293452:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660827520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211722.293505:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211722.293631:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660827520 00000100:00100000:2.0:1788211722.293639:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660827520 00000100:00100000:2.0:1788211722.293685:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788211722.293696:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660827520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211722.300736:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660827520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7031us (7219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211722.300754:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788211722.301024:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211722.301051:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660827520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211722.301109:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660827648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211722.301213:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211722.301237:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211722.301725:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660827648 00000100:00100000:2.0:1788211722.301733:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660827648 00000100:00100000:2.0:1788211722.301778:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788211722.301788:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660827648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211722.302019:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660827648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211722.302027:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788211722.302076:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660827648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788211722.302921:0:11196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788211722.303022:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788211722.303044:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788211722.303065:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a55f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211722.303078:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a55f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211722.303090:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788211722.303092:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ac001fd6800 from 7 10000000:01000000:0.0:1788211722.303103:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788211722.303260:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211722.303269:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211722.303279:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211722.303301:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660827776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788211722.303350:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211722.303389:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211722.304821:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660827776 00000100:00100000:1.0:1788211722.304838:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660827776 00000100:00100000:1.0:1788211722.304910:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788211722.304923:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660827776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211722.304943:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211722.304963:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a5603 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a55fc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.304996:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a5603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a55fc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.305007:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a5603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a55fc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.305018:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06a00, rc 0) 00000100:00100000:1.0:1788211722.307379:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660827776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2449us (4018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211722.307391:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788211722.307643:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660827776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788211722.307670:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5603 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211722.307683:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5603 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211722.307775:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660827904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211722.307821:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211722.307865:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfefab5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788211722.307913:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660827904 00000100:00100000:3.0:1788211722.307920:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660827904 00000100:00100000:3.0:1788211722.307967:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788211722.307978:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660827904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211722.308304:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660827904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211722.308312:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788211722.310556:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660827904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211722.310633:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660828032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211722.310758:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211722.310807:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfefab5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788211722.310853:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660828032 00000100:00100000:3.0:1788211722.310862:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660828032 00000100:00100000:3.0:1788211722.310920:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788211722.310929:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660828032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788211722.311160:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660828032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211722.311207:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788211722.311313:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660828032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788211722.319559:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788211722.319807:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788211722.319829:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788211722.319840:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5603 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211722.319852:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5603 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211722.319862:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788211722.319865:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfc288e800 from 7 10000000:01000000:3.0:1788211722.319868:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788211722.319913:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211722.319922:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211722.319932:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211722.319959:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660828160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788211722.320032:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211722.320081:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788211722.321764:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660828160 00000100:00100000:2.0:1788211722.321782:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660828160 00000100:00100000:2.0:1788211722.321859:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788211722.321871:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660828160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788211722.321888:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211722.321907:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abffdb81800/0x2afbce82f55a5611 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a560a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211722.321935:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb81800/0x2afbce82f55a5611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a560a expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211722.321946:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abffdb81800/0x2afbce82f55a5611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a560a expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211722.321955:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81800, rc 0) 00000100:00100000:2.0:1788211722.322027:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660828160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211722.322046:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788211722.322217:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660828160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788211722.322238:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5611 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211722.322249:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5611 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211722.322337:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660828288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211722.322373:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211722.322408:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788211722.322485:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660828288 00000100:00100000:2.0:1788211722.322491:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660828288 00000100:00100000:2.0:1788211722.322516:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788211722.322524:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660828288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211722.322784:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660828288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211722.322791:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788211722.322934:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660828288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211722.322963:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660828416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788211722.323004:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211722.323037:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788211722.323091:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660828416 00000100:00100000:2.0:1788211722.323095:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660828416 00000100:00100000:2.0:1788211722.324732:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788211722.324754:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660828416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211722.324994:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660828416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211722.325002:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788211722.325143:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660828416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788211722.329621:0:11198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788211722.329715:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788211722.329737:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788211722.329852:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5611 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211722.329866:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5611 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211722.407429:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211722.655067:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211722.655206:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637722368 00000100:00100000:1.0:1788211722.655216:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637722368 00000100:00100000:1.0:1788211722.655284:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 241 00000100:00100000:1.0:1788211722.655297:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:5602:x1875075637722368:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211722.655316:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211722.655342:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a5618 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f57b7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.655390:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a5618 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57b7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.655402:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a5618 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57b7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.655413:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06800, rc 0) 00000100:00100000:1.0:1788211722.655480:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:5602:x1875075637722368:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 186us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211722.655487:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 241 00000100:00100000:2.0:1788211722.664792:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211722.665996:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637722496 00000100:00100000:0.0:1788211722.666010:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637722496 00000100:00100000:0.0:1788211722.666116:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 242 00000100:00100000:0.0:1788211722.666128:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:5602:x1875075637722496:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211722.666468:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:5602:x1875075637722496:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 340us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211722.666484:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 242 00000100:00100000:0.0:1788211722.672254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211722.676263:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637722624 00000100:00100000:3.0:1788211722.676289:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637722624 00000100:00100000:3.0:1788211722.676405:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 243 00000100:00100000:3.0:1788211722.676419:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:5602:x1875075637722624:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788211722.676740:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:5602:x1875075637722624:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 322us (4502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211722.676748:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 243 00000100:00100000:2.0:1788211722.693879:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211722.694356:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637722752 00000100:00100000:1.0:1788211722.694368:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637722752 00000100:00100000:1.0:1788211722.694427:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 244 00000100:00100000:1.0:1788211722.694438:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:5602:x1875075637722752:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211722.694457:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211722.694477:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a561f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f57be expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.694505:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a561f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57be expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.694621:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a561f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57be expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211722.694630:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06600, rc 0) 00000100:00100000:1.0:1788211722.694891:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:5602:x1875075637722752:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 452us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211722.694913:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 244 00000100:00100000:2.0:1788211722.703601:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211722.703709:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637722880 00000100:00100000:0.0:1788211722.703722:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637722880 00000100:00100000:0.0:1788211722.703781:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 245 00000100:00100000:0.0:1788211722.703792:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:5602:x1875075637722880:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211722.704103:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:5602:x1875075637722880:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 311us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211722.704121:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 245 00000100:00100000:2.0:1788211722.712823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211722.717422:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637723008 00000100:00100000:1.0:1788211722.717438:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637723008 00000100:00100000:1.0:1788211722.717495:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 246 00000100:00100000:1.0:1788211722.717504:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:5602:x1875075637723008:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788211722.717884:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:5602:x1875075637723008:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 380us (5069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211722.717893:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 246 00010000:00010000:2.0:1788211723.429969:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211724.458011:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211725.031162:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660828544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211725.031275:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211725.031380:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660828544 00000100:00100000:3.0:1788211725.031391:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660828544 00000100:00100000:3.0:1788211725.031459:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788211725.031470:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660828544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788211725.031508:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211725.031553:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660828544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211725.031571:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788211725.031594:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788211725.031641:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffdc7ea00 x1875075660828544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211725.031662:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660828544:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788211725.487373:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211725.541878:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660828928:0@lo:400:kworker.0 00000100:00100000:1.0:1788211725.542008:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660828800:0@lo:400:kworker.0 00000100:00100000:2.0:1788211725.542076:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660828672:0@lo:400:kworker.0 00000100:00100000:1.0:1788211725.545678:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211725.549797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211725.549896:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660829184:0@lo:400:kworker.0 00000100:00100000:2.0:1788211725.549959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211725.550032:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660828800 00000100:00100000:2.0:1788211725.550061:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660828800 00000100:00100000:2.0:1788211725.550123:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788211725.550143:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660828800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211725.550234:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660828800:12345-0@lo:400:kworker.0 Request processed in 102us (4564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211725.550243:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788211725.550273:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660829184 00000100:00100000:2.0:1788211725.550277:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660829184 00000100:00100000:2.0:1788211725.550316:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788211725.550323:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660829184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211725.550363:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660829184:12345-0@lo:400:kworker.0 Request processed in 41us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211725.550370:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788211725.550421:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe07e300 x1875075660829184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211725.550438:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660829184:0@lo:400:kworker.0 00000100:00100000:2.0:1788211725.550473:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660828800:0@lo:400:kworker.0 00000100:00100000:2.0:1788211725.550520:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660828672 00000100:00100000:2.0:1788211725.550525:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660828672 00000100:00100000:2.0:1788211725.550562:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788211725.550570:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660828672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211725.550608:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660828672:12345-0@lo:400:kworker.0 Request processed in 39us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211725.550615:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788211725.550649:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660829056:0@lo:400:kworker.0 00000100:00100000:2.0:1788211725.550693:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211725.550735:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660828672:0@lo:400:kworker.0 00000100:00080000:2.0:1788211725.550758:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788211725.550775:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660829056 00000100:00100000:2.0:1788211725.550779:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660829056 00000100:00100000:2.0:1788211725.550808:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788211725.550815:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660829056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211725.550851:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660829056:12345-0@lo:400:kworker.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211725.550858:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788211725.550873:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211725.550890:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660829056:0@lo:400:kworker.0 00000100:00100000:3.0:1788211725.559181:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211725.559881:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660828928 00000100:00100000:2.0:1788211725.559891:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660828928 00000100:00100000:2.0:1788211725.560033:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788211725.560043:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660828928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211725.560227:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660828928:12345-0@lo:400:kworker.0 Request processed in 183us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211725.560235:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788211725.560327:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660828928:0@lo:400:kworker.0 00000100:00080000:3.0:1788211725.560391:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211726.054375:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211726.054398:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660829312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211726.054475:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211726.054555:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660829312 00000100:00100000:2.0:1788211726.054564:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660829312 00000100:00100000:2.0:1788211726.054624:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788211726.054635:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660829312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211726.054695:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211726.054750:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660829312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211726.054758:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788211726.054809:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfca87aa00 x1875075660829312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211726.054830:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660829312:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788211726.102636:0:11373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788211726.505048:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211726.554672:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211726.555223:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211726.555259:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211726.555359:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637723136 00000100:00100000:3.0:1788211726.555370:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637723136 00000100:00100000:3.0:1788211726.555438:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 248 00000100:00100000:3.0:1788211726.555460:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637723136:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211726.555536:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637723136:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 88us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211726.555545:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 248 00000100:00100000:2.0:1788211726.556293:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637723264 00000100:00100000:2.0:1788211726.556301:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637723264 00000100:00100000:2.0:1788211726.556367:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637723392 00000100:00100000:2.0:1788211726.556371:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637723392 00000100:00100000:2.0:1788211726.556406:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 103 00000100:00100000:2.0:1788211726.556416:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637723264:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211726.556422:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 104 00000100:00100000:1.0:1788211726.556435:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637723392:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211726.556474:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637723264:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 59us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211726.556477:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637723392:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 45us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211726.556486:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 103 00000100:00100000:1.0:1788211726.556493:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 104 00000100:00080000:3.0:1788211726.556840:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788211727.525552:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211728.574442:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211729.577439:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211730.149847:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788211730.149878:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660829440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211730.149979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211730.150043:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660829440 00000100:00100000:3.0:1788211730.150052:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660829440 00000100:00100000:3.0:1788211730.150146:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788211730.150189:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660829440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788211730.150237:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211730.150293:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660829440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211730.150301:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788211730.155030:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788211730.155123:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe07e680 x1875075660829440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211730.155151:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660829440:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788211730.576263:0:11473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 17:28:47 (1788211727) === 00010000:00010000:1.0:1788211730.599482:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211730.663000:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660829568:0@lo:400:kworker.0 00000100:00100000:3.0:1788211730.663104:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211730.663156:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660830080:0@lo:400:kworker.0 00000100:00100000:3.0:1788211730.663203:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211730.663232:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788211730.663238:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660829952:0@lo:400:kworker.0 00000100:00100000:3.0:1788211730.663263:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211730.663295:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660829696:0@lo:400:kworker.0 00000100:00100000:3.0:1788211730.663319:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211730.663335:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788211730.663340:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660829824:0@lo:400:kworker.0 00000100:00100000:3.0:1788211730.663359:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211730.663670:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660829568 00000100:00100000:3.0:1788211730.663678:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660829568 00000100:00100000:3.0:1788211730.663724:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788211730.663732:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660829568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211730.663981:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660829952 00000100:00100000:1.0:1788211730.663987:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660829952 00000100:00100000:1.0:1788211730.664152:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660829696 00000100:00100000:1.0:1788211730.664157:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660829696 00000100:00100000:1.0:1788211730.664193:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660829824 00000100:00100000:1.0:1788211730.664196:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660829824 00000100:00100000:1.0:1788211730.664224:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788211730.664230:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660829952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211730.664294:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660829952:12345-0@lo:400:kworker.0 Request processed in 64us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211730.664301:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788211730.664318:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788211730.664325:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660829696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211730.664357:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660829696:12345-0@lo:400:kworker.0 Request processed in 33us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211730.664363:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788211730.664382:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788211730.664389:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660829824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211730.664415:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660829824:12345-0@lo:400:kworker.0 Request processed in 28us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211730.664422:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1788211730.664445:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211730.665996:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660829568:12345-0@lo:400:kworker.0 Request processed in 2257us (2885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211730.666009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788211730.666222:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660830080 00000100:00100000:3.0:1788211730.666230:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660830080 00000100:00100000:3.0:1788211730.666287:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788211730.666297:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660830080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211730.666339:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660830080:12345-0@lo:400:kworker.0 Request processed in 45us (3135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211730.666345:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788211730.668520:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788211730.668597:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660829824:0@lo:400:kworker.0 00000100:00100000:3.0:1788211730.668616:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660829696:0@lo:400:kworker.0 00000100:00100000:3.0:1788211730.668664:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660829952:0@lo:400:kworker.0 00000100:00100000:3.0:1788211730.668677:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660829568:0@lo:400:kworker.0 00010000:00080000:3.0:1788211730.668693:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe07dc00 x1875075660830080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211730.668704:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660830080:0@lo:400:kworker.0 00000100:00100000:3.0:1788211730.859458:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211730.859832:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637723520 00000100:00100000:1.0:1788211730.859845:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637723520 00000100:00100000:1.0:1788211730.859944:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:1.0:1788211730.859967:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637723520:12345-192.168.204.29@tcp:41:mkdir.0 00000004:00000024:1.0:1788211730.860035:0:6717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788211730.860150:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637723520:12345-192.168.204.29@tcp:41:mkdir.0 Request processed in 186us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211730.860158:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00080000:3.0:1788211730.860334:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211730.861021:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211730.864273:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637723648 00000100:00100000:3.0:1788211730.864456:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637723648 00000100:00100000:3.0:1788211730.864547:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:3.0:1788211730.864563:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:9694:x1875075637723648:12345-192.168.204.29@tcp:700:mkdir.0 00000100:00100000:3.0:1788211730.865689:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:9694:x1875075637723648:12345-192.168.204.29@tcp:700:mkdir.0 Request processed in 1122us (4662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211730.865704:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:0.0:1788211730.869084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211730.870073:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637723904 00000100:00100000:3.0:1788211730.870090:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637723904 00000100:00100000:3.0:1788211730.870158:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:3.0:1788211730.870195:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:9694:x1875075637723904:12345-192.168.204.29@tcp:36:mkdir.0 00010000:00010000:3.0:1788211730.870268:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211730.870654:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5507 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5740 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.870703:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec800) 00010000:00010000:3.0:1788211730.870717:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788211730.872589:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5626 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.872622:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5626 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.872634:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5626 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.872649:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a562d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.872655:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a562d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.872661:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a562d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211730.875742:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788211730.875769:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5626 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.875781:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5626 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.875789:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5626 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.875795:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211730.875800:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5626 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.875808:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5626 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.875839:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434e00) 00010000:00010000:0.0:1788211730.875842:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211730.875847:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5626 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.875854:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5626 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788211730.875881:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034d6c651 reply state 0000000053548fd0 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a562d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211730.875891:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788211730.876033:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:9694:x1875075637723904:12345-192.168.204.29@tcp:36:mkdir.0 Request processed in 5860us (6959us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788211730.876044:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00010000:00010000:3.0:1788211730.880577:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a562d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.880601:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a562d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.880611:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a562d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.880619:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211730.880626:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a562d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.880635:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a562d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.880659:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8abfdb434900) 00010000:00010000:3.0:1788211730.880662:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211730.880668:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a562d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.880676:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a562d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211730.900585:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211730.900971:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637724032 00000100:00100000:3.0:1788211730.900982:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637724032 00000100:00100000:3.0:1788211730.901104:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:3.0:1788211730.901116:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:9695:x1875075637724032:12345-192.168.204.29@tcp:101:chmod.0 00010000:00010000:3.0:1788211730.901157:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211730.901220:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f57c5 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.901298:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a563b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.901312:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a563b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.901324:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a563b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211730.901421:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788211730.901425:0:9952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211730.901477:0:9952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a563b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.901508:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57c5 expref: 8 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.901530:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a563b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57c5 expref: 7 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.901538:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc5bbe600) 00010000:00010000:3.0:1788211730.901541:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788211730.901546:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062c00, rc 0) 00000100:00100000:3.0:1788211730.901617:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:9695:x1875075637724032:12345-192.168.204.29@tcp:101:chmod.0 Request processed in 502us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211730.901625:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:3.0:1788211730.908422:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211730.908854:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637724288 00000100:00100000:0.0:1788211730.908869:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637724288 00000100:00100000:0.0:1788211730.908957:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:0.0:1788211730.908969:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:9695:x1875075637724288:12345-192.168.204.29@tcp:36:chmod.0 00010000:00010000:0.0:1788211730.909043:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211730.909075:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a563b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57c5 expref: 7 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.909101:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc5bbe600) 00010000:00010000:0.0:1788211730.909114:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788211730.909146:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5642 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.909228:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5642 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.909240:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5642 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788211730.909607:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d73fd7e reply state 00000000c01a6e80 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5642 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211730.909616:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788211730.909630:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788211730.909743:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:9695:x1875075637724288:12345-192.168.204.29@tcp:36:chmod.0 Request processed in 776us (1330us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788211730.909750:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00010000:00010000:1.0:1788211730.915570:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5642 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211730.915614:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5642 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211730.915623:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5642 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211730.915631:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211730.915638:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5642 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211730.915647:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5642 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211730.915670:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434e00) 00010000:00010000:1.0:1788211730.915674:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788211730.915679:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5642 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211730.915686:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5642 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211730.956640:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211730.956955:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637724416 00000100:00100000:0.0:1788211730.956968:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637724416 00000100:00100000:0.0:1788211730.957048:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:0.0:1788211730.957060:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:9696:x1875075637724416:12345-192.168.204.29@tcp:101:chown.0 00010000:00010000:0.0:1788211730.957087:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211730.957125:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f57cc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.957368:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5650 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.957383:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.957396:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211730.957486:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788211730.957491:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788211730.957545:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.957577:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57cc expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.957597:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57cc expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211730.957605:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434100) 00010000:00010000:0.0:1788211730.957609:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788211730.957612:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030c00, rc 0) 00000100:00100000:0.0:1788211730.957686:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:9696:x1875075637724416:12345-192.168.204.29@tcp:101:chown.0 Request processed in 628us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211730.957696:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:0.0:1788211730.963262:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211730.963607:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637724544 00000100:00100000:3.0:1788211730.963621:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637724544 00000100:00100000:3.0:1788211730.963703:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:3.0:1788211730.963899:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:9696:x1875075637724544:12345-192.168.204.29@tcp:101:chown.0 00010000:00010000:3.0:1788211730.963929:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211730.963964:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5657 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f57d3 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.964054:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a565e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.964071:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a565e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.964083:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a565e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.964100:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a5665 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.964107:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a5665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.964113:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a5665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.964258:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a566c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.964266:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a566c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.964903:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a566c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211730.964983:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788211730.964989:0:9952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211730.965027:0:9952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a566c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965042:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a565e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965049:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a565e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965057:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a565e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965062:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211730.965067:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a565e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965075:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a565e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965090:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434100) 00010000:00010000:3.0:1788211730.965093:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211730.965099:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a565e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965105:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a565e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965136:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a5665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965142:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a5665 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965146:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a5665 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965151:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211730.965154:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a5665 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965160:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a5665 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965215:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8abfc5bbe100) 00010000:00010000:3.0:1788211730.965219:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211730.965222:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a5665 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965228:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a5665 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.965280:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5657 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57d3 expref: 10 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.966817:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a566c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57d3 expref: 9 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.966862:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8abfc5bbea00) 00010000:00010000:3.0:1788211730.966866:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788211730.966870:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063400, rc 0) 00000100:00100000:3.0:1788211730.967053:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:9696:x1875075637724544:12345-192.168.204.29@tcp:101:chown.0 Request processed in 3337us (3801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211730.967064:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:2.0:1788211730.980005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211730.980123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637724800 00000100:00100000:3.0:1788211730.980135:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637724800 00000100:00100000:3.0:1788211730.980228:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:3.0:1788211730.980241:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:9696:x1875075637724800:12345-192.168.204.29@tcp:36:chown.0 00010000:00010000:3.0:1788211730.980330:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211730.980378:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a566c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57d3 expref: 9 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.980401:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8abfc5bbea00) 00010000:00010000:3.0:1788211730.980412:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788211730.980445:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5673 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.980458:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211730.980700:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788211731.070339:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1788211731.070380:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788211731.070548:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f21cae19 reply state 00000000e18c5ca9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211731.070566:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788211731.070984:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1788211731.071236:0:5844:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788211731.071263:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:9696:x1875075637724800:12345-192.168.204.29@tcp:36:chown.0 Request processed in 91019us (91264us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788211731.071275:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00010000:00010000:3.0:1788211731.072023:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.072053:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5673 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.072061:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.072067:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211731.072072:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.072079:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5673 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.072102:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:3.0:1788211731.072105:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788211731.072110:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5673 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.072117:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5673 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211731.089566:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211731.089759:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637724928 00000100:00100000:1.0:1788211731.089771:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637724928 00000100:00100000:1.0:1788211731.089959:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:1.0:1788211731.089972:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:9697:x1875075637724928:12345-192.168.204.29@tcp:101:touch.500 00010000:00010000:1.0:1788211731.089998:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211731.090022:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a567a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f57da expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788211731.097451:0:6717:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 7365us 00010000:00010000:1.0:1788211731.112903:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5681 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.112930:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5681 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.112956:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5681 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.112974:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5688 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.112981:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.112987:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.116057:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a568f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.116078:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a568f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.116089:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a568f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211731.116884:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788211731.116891:0:6717:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788211731.117041:0:6717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a568f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117058:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5681 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117073:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5681 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117079:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5681 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117086:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211731.117091:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5681 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117099:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5681 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117115:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434100) 00010000:00010000:1.0:1788211731.117118:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211731.117123:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117128:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a5681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117141:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117147:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5688 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117153:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5688 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117158:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211731.117182:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5688 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117189:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5688 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117350:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8abfc37ece00) 00010000:00010000:1.0:1788211731.117353:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211731.117357:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5688 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117569:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5688 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117617:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a567a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57da expref: 8 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117707:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a568f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57da expref: 7 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.117716:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:1.0:1788211731.117719:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788211731.117722:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07c00, rc 0) 00000100:00100000:1.0:1788211731.117811:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:9697:x1875075637724928:12345-192.168.204.29@tcp:101:touch.500 Request processed in 27841us (28258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211731.117820:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1788211731.122238:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211731.122515:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637725184 00000100:00100000:3.0:1788211731.122529:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637725184 00000100:00100000:3.0:1788211731.122598:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:3.0:1788211731.122609:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:9697:x1875075637725184:12345-192.168.204.29@tcp:101:touch.500 00010000:00010000:3.0:1788211731.122632:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211731.122656:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5696 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f57e1 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.123283:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a569d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.123538:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a569d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.123549:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a569d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.123567:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a56a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.123574:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a56a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.123581:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a56a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788211731.125700:0:9952:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788211731.126083:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a56ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.126098:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a56ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.126261:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a56ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.126653:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a569d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.126662:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a569d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.126669:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a569d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.126675:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211731.126680:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a569d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.126688:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a569d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.126703:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:2.0:1788211731.126706:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211731.126712:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a569d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.126795:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a569d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788211731.126812:0:9952:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfb9858d reply state 00000000320be54c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a56a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211731.126833:0:9952:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788211731.126886:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5696 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57e1 expref: 10 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.126904:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a56ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57e1 expref: 9 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.126912:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8abfc5bbea00) 00010000:00010000:2.0:1788211731.126915:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211731.126917:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063200, rc 0) 00000100:00100000:2.0:1788211731.127069:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:9697:x1875075637725184:12345-192.168.204.29@tcp:101:touch.500 Request processed in 4461us (4842us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788211731.127080:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:2.0:1788211731.135704:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1788211731.136011:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a56a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.136026:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a56a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.136049:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a56a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.136056:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211731.136061:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a56a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.136068:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a56a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.136086:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4a848b87 (ffff8abfc5bbec00) 00010000:00010000:1.0:1788211731.136089:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211731.136093:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a56a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.136100:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a56a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211731.136325:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637725440 00000100:00100000:3.0:1788211731.136335:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637725440 00000100:00100000:3.0:1788211731.136405:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:3.0:1788211731.136416:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:9697:x1875075637725440:12345-192.168.204.29@tcp:36:touch.500 00010000:00010000:3.0:1788211731.136486:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211731.136511:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063200/0x2afbce82f55a56ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57e1 expref: 9 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.136523:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8abfc5bbea00) 00010000:00010000:3.0:1788211731.136530:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788211731.136578:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a56b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.136590:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a56b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.136600:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a56b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788211731.136734:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e4b67e3 reply state 0000000093206597 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a56b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211731.136743:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788211731.137026:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:9697:x1875075637725440:12345-192.168.204.29@tcp:36:touch.500 Request processed in 611us (1330us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788211731.137034:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00010000:00010000:3.0:1788211731.142359:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a56b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.142388:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a56b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.142397:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a56b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.142403:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211731.142409:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a56b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.142436:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a56b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.142455:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:3.0:1788211731.142458:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211731.142464:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a56b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.142470:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a56b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211731.145027:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211731.145222:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637725568 00000100:00100000:1.0:1788211731.145236:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637725568 00000100:00100000:1.0:1788211731.145301:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:1.0:1788211731.145311:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:9697:x1875075637725568:12345-192.168.204.29@tcp:101:touch.500 00010000:00010000:1.0:1788211731.145341:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211731.145382:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a56c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f57e8 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.145460:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a56c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57e8 expref: 10 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.145503:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a56c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57e8 expref: 10 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.145530:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8abfc37ece00) 00010000:00010000:1.0:1788211731.145535:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788211731.145539:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07200, rc 0) 00000100:00100000:1.0:1788211731.145625:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:9697:x1875075637725568:12345-192.168.204.29@tcp:101:touch.500 Request processed in 314us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211731.145632:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:0.0:1788211731.149043:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211731.149248:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637725696 00000100:00100000:2.0:1788211731.149261:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637725696 00000100:00100000:2.0:1788211731.149316:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:2.0:1788211731.149328:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875075637725696:12345-192.168.204.29@tcp:8:touch.500 00010000:00080000:2.0:1788211731.149384:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:2.0:1788211731.149429:0:6696:0:(genops.c:1385:class_connect()) connect: client a688ef06-7eb0-4c47-9425-de9843f5c0e0, cookie 0x2afbce82f55a56c7 00002000:00100000:2.0:1788211731.149445:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a688ef06-7eb0-4c47-9425-de9843f5c0e0/ffff8abfd87cf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788211731.149477:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788211731.149893:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788211731.149928:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8abfd87c9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211731.150091:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2357:x1875075637725696:12345-192.168.204.29@tcp:8:touch.500 Request processed in 762us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211731.150101:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:2.0:1788211731.161622:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211731.161860:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637725824 00000100:00100000:3.0:1788211731.161871:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637725824 00000100:00100000:3.0:1788211731.162081:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:3.0:1788211731.162095:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:0:x1875075637725824:12345-192.168.204.29@tcp:2:touch.500 00000100:00080000:1.0:1788211731.162704:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788211731.177193:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788211731.177223:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660830208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211731.177315:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211731.177403:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660830208 00000100:00100000:2.0:1788211731.177412:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660830208 00000100:00100000:2.0:1788211731.177471:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788211731.177481:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660830208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211731.177506:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211731.177554:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660830208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211731.177561:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788211731.177607:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef8a6a00 x1875075660830208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211731.177625:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660830208:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788211731.213443:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000001:00080000:1.0:1788211731.213478:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788211731.213650:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:0:x1875075637725824:12345-192.168.204.29@tcp:2:touch.500 Request processed in 51547us (52032us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788211731.213664:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:1.0:1788211731.218428:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211731.218545:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637726080 00000100:00100000:2.0:1788211731.218559:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637726080 00000100:00100000:2.0:1788211731.218629:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:2.0:1788211731.218643:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:9697:x1875075637726080:12345-192.168.204.29@tcp:35:touch.500 00000100:00100000:2.0:1788211731.219068:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+11:9697:x1875075637726080:12345-192.168.204.29@tcp:35:touch.500 Request processed in 427us (657us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788211731.219078:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:1.0:1788211731.231822:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211731.232276:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637726208 00000100:00100000:2.0:1788211731.232314:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637726208 00000100:00100000:2.0:1788211731.232498:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:2.0:1788211731.232511:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+11:9698:x1875075637726208:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:2.0:1788211731.232543:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211731.232571:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81400/0x2afbce82f55a56ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f57ef expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.232657:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a56d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.232675:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a56d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.232689:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a56d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211731.232763:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788211731.232767:0:9952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211731.232819:0:9952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a56d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.232866:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81400/0x2afbce82f55a56ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57ef expref: 13 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.232887:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a56d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57ef expref: 12 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.232897:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:2.0:1788211731.232900:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211731.232904:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81200, rc 0) 00000100:00100000:2.0:1788211731.233003:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+12:9698:x1875075637726208:12345-192.168.204.29@tcp:101:rm.0 Request processed in 495us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211731.233012:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:3.0:1788211731.239514:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211731.240237:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637726464 00000100:00100000:0.0:1788211731.240252:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637726464 00000100:00100000:0.0:1788211731.240347:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:0.0:1788211731.240370:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+12:9698:x1875075637726464:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:0.0:1788211731.240401:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211731.240433:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a56dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f57f6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211731.240632:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788211731.240862:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a56dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57f6 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.240880:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434100) 00010000:00010000:0.0:1788211731.240884:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788211731.240890:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a56dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57f6 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.240908:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030400, rc 0) 00000100:00100000:0.0:1788211731.241021:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:9698:x1875075637726464:12345-192.168.204.29@tcp:101:rm.0 Request processed in 659us (1517us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788211731.241030:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:3.0:1788211731.247814:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211731.248402:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637726592 00000100:00100000:2.0:1788211731.248420:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637726592 00000100:00100000:2.0:1788211731.248497:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:2.0:1788211731.248512:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:9698:x1875075637726592:12345-192.168.204.29@tcp:37:rm.0 00000100:00100000:1.0:1788211731.259142:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:9698:x1875075637726592:12345-192.168.204.29@tcp:37:rm.0 Request processed in 10619us (11330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211731.259160:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:1.0:1788211731.263637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211731.264074:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637726848 00000100:00100000:0.0:1788211731.264086:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637726848 00000100:00100000:0.0:1788211731.264322:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:0.0:1788211731.264334:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc64fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:9698:x1875075637726848:12345-192.168.204.29@tcp:35:rm.0 00000100:00100000:0.0:1788211731.264637:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc64fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:9698:x1875075637726848:12345-192.168.204.29@tcp:35:rm.0 Request processed in 304us (1019us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788211731.264645:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:1.0:1788211731.269547:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211731.269651:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637727104 00000100:00100000:0.0:1788211731.269661:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637727104 00000100:00100000:0.0:1788211731.270012:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:0.0:1788211731.270023:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:9698:x1875075637727104:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:0.0:1788211731.270048:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211731.270083:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a56ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f57fd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.270263:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030000/0x2afbce82f55a56f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.270277:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030000/0x2afbce82f55a56f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.270413:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030000/0x2afbce82f55a56f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211731.270428:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788211731.270692:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a56ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57fd expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.270711:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030000/0x2afbce82f55a56f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57fd expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.270868:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:0.0:1788211731.270871:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788211731.270876:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030000, rc 0) 00000100:00100000:0.0:1788211731.271083:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:9698:x1875075637727104:12345-192.168.204.29@tcp:101:rm.0 Request processed in 1060us (1544us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788211731.271093:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:2.0:1788211731.275552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211731.275640:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637727232 00000100:00100000:3.0:1788211731.275650:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637727232 00000100:00100000:3.0:1788211731.275723:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:3.0:1788211731.275735:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:9698:x1875075637727232:12345-192.168.204.29@tcp:41:rm.0 00000004:00000024:3.0:1788211731.275796:0:9952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788211731.275885:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:9698:x1875075637727232:12345-192.168.204.29@tcp:41:rm.0 Request processed in 152us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211731.275892:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:1.0:1788211731.278673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211731.278875:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637727360 00000100:00100000:2.0:1788211731.278886:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637727360 00000100:00100000:2.0:1788211731.278961:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:2.0:1788211731.278972:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:9698:x1875075637727360:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:2.0:1788211731.278994:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211731.279020:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a56ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5804 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279090:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a5706 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279106:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a5706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279119:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a5706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279134:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a570d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279141:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a570d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279206:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a570d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279338:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279347:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279354:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211731.279386:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788211731.279392:0:6717:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211731.279413:0:6717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279427:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279435:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a5706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279442:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a5706 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279449:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a5706 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279455:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80a00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211731.279459:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a5706 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279476:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a5706 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279489:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:2.0:1788211731.279492:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211731.279497:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a5706 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279503:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a5706 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279517:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a570d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279524:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a570d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279529:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a570d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279535:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211731.279538:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a570d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279544:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a570d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279551:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4a848b87 (ffff8abfc9a0d500) 00010000:00010000:2.0:1788211731.279554:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211731.279556:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a570d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279573:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a570d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279611:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a56ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5804 expref: 18 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279639:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5804 expref: 17 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211731.279647:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8abfc37ece00) 00010000:00010000:2.0:1788211731.279650:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211731.279653:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80400, rc 0) 00000100:00100000:2.0:1788211731.279746:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:9698:x1875075637727360:12345-192.168.204.29@tcp:101:rm.0 Request processed in 775us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211731.279755:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:1.0:1788211731.284085:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211731.284204:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637727616 00000100:00100000:0.0:1788211731.284217:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637727616 00000100:00100000:0.0:1788211731.284287:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:0.0:1788211731.284299:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:9698:x1875075637727616:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:0.0:1788211731.284385:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788211731.284420:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5804 expref: 17 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.284450:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a56c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57e8 expref: 16 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.284463:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8abfc37ece00) 00010000:00010000:0.0:1788211731.284481:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a56d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57ef expref: 15 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.284490:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:0.0:1788211731.284493:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788211731.284519:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a571b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.284536:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a571b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.284547:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a571b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.284565:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a5722 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.284571:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a5722 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.284577:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a5722 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.284892:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5729 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.284902:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5729 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.284909:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5729 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788211731.286100:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788211731.286115:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320591947446ns, next at 321591944862ns, rc = 0 00010000:00010000:0.0:1788211731.286273:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5730 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286292:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286303:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286312:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5730 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286318:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5730 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286324:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5730 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286364:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788211731.286392:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5729 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286405:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5729 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286412:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5729 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286419:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211731.286424:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5729 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286432:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5729 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286445:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8abfdb434a00) 00010000:00010000:0.0:1788211731.286448:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788211731.286453:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5729 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286459:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030600/0x2afbce82f55a5729 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286479:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a571b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286485:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a571b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286490:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a571b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286495:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211731.286503:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a571b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286510:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a571b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286519:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:0.0:1788211731.286521:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211731.286524:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a571b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.286530:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030400/0x2afbce82f55a571b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788211731.286540:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ccae8c7d reply state 00000000b7594be4 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a5722 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211731.286549:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788211731.286873:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211731.286880:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5730 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.286893:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cce00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211731.286897:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5730 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.286903:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5730 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.286912:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8abfdb434a00) 00010000:00010000:3.0:1788211731.286914:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788211731.286917:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5730 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.286922:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5730 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.286947:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211731.286950:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211731.286952:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211731.287064:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:9698:x1875075637727616:12345-192.168.204.29@tcp:36:rm.0 Request processed in 2759us (2987us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788211731.287075:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 30 00010000:00010000:1.0:1788211731.290053:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a5722 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.290093:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a5722 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.290111:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a5722 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.290117:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211731.290122:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a5722 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.290130:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a5722 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.290146:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4a848b87 (ffff8abfdb434d00) 00010000:00010000:1.0:1788211731.290149:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211731.290153:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a5722 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.290159:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030200/0x2afbce82f55a5722 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211731.293230:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211731.294041:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637727872 00000100:00100000:2.0:1788211731.294056:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637727872 00000100:00100000:2.0:1788211731.294139:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:2.0:1788211731.294150:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:9698:x1875075637727872:12345-192.168.204.29@tcp:35:rm.0 00000100:00100000:2.0:1788211731.295572:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:9698:x1875075637727872:12345-192.168.204.29@tcp:35:rm.0 Request processed in 1419us (2347us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788211731.295583:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:2.0:1788211731.299616:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211731.300506:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637728128 00000100:00100000:0.0:1788211731.300520:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637728128 00000100:00100000:0.0:1788211731.300661:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:0.0:1788211731.300673:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:9698:x1875075637728128:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:0.0:1788211731.300751:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788211731.300784:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030000/0x2afbce82f55a56f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57fd expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.300808:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a568f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57da expref: 15 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.300854:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:0.0:1788211731.300881:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030c00/0x2afbce82f55a5650 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57cc expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.300889:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434100) 00010000:00010000:0.0:1788211731.300898:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788211731.300928:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5737 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.300952:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5737 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.300962:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5737 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.300975:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a573e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.300982:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a573e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.300989:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a573e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.301646:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5745 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.301663:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5745 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.301680:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5745 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211731.303457:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788211731.303486:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5745 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303497:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5745 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303505:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5745 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303511:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211731.303516:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5745 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303523:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5745 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303539:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8abfdb434600) 00010000:00010000:0.0:1788211731.303543:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788211731.303548:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5745 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303555:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5745 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303585:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5737 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303592:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5737 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303605:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5737 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303610:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cde00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211731.303613:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5737 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303739:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5737 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303752:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:0.0:1788211731.303754:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211731.303758:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5737 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211731.303764:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5737 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788211731.303778:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007efa6f0 reply state 00000000cc9c8559 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a573e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211731.303788:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788211731.304099:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:9698:x1875075637728128:12345-192.168.204.29@tcp:36:rm.0 Request processed in 3420us (4501us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788211731.304116:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 31 00010000:00010000:3.0:1788211731.311302:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a573e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.311327:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a573e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.311336:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a573e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.311343:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cda00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211731.311349:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a573e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.311395:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a573e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.311417:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8abfdb434700) 00010000:00010000:3.0:1788211731.311420:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211731.311426:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a573e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211731.311432:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a573e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211731.621593:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211731.678608:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211731.678650:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211731.678684:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211731.678773:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211731.678859:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637728384 00000100:00100000:3.0:1788211731.678868:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637728384 00000100:00100000:3.0:1788211731.678939:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637728640 00000100:00100000:3.0:1788211731.678942:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637728640 00000100:00100000:3.0:1788211731.678978:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 108 00000100:00100000:3.0:1788211731.678993:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:2358:x1875075637728384:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211731.679079:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:2358:x1875075637728384:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 91us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211731.679086:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 108 00000100:00100000:3.0:1788211731.679103:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 109 00000100:00100000:3.0:1788211731.679110:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637728640:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211731.679134:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637728640:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211731.679140:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 109 00000100:00080000:3.0:1788211731.679156:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211731.679994:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637728256 00000100:00100000:0.0:1788211731.680002:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637728256 00000100:00100000:0.0:1788211731.680052:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 250 00000100:00100000:0.0:1788211731.680062:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2358:x1875075637728256:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211731.680129:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2358:x1875075637728256:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 69us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211731.680136:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 250 00000100:00100000:0.0:1788211731.680198:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637728512 00000100:00100000:0.0:1788211731.680203:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637728512 00000100:00100000:0.0:1788211731.680237:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:0.0:1788211731.680245:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637728512:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211731.680274:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637728512:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211731.680292:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 50 00010000:00010000:3.0:1788211732.645547:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211733.670612:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211734.693570:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211735.269737:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660830336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788211735.269848:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211735.276939:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660830336 00000100:00100000:3.0:1788211735.276960:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660830336 00000100:00100000:3.0:1788211735.277079:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788211735.277093:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660830336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788211735.277143:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211735.277294:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660830336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 204us (7445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211735.277303:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788211735.277458:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe07ed80 x1875075660830336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211735.277483:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660830336:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788211735.278280:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788211735.720743:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211735.790080:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660830592:0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.790163:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211735.790245:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660831104:0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.790274:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211735.790306:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788211735.790313:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660830464:0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.790342:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211735.790845:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660830976:0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.790885:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211735.790919:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660830720:0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.790957:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211735.790981:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211735.790987:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660830848:0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.791008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211735.791042:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660830592 00000100:00100000:0.0:1788211735.791051:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660830592 00000100:00100000:0.0:1788211735.791102:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660830976 00000100:00100000:0.0:1788211735.791105:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660830976 00000100:00100000:0.0:1788211735.791129:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660830720 00000100:00100000:0.0:1788211735.791131:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660830720 00000100:00100000:0.0:1788211735.791146:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788211735.791154:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660830592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.791227:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660830592:12345-0@lo:400:kworker.0 Request processed in 73us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211735.791234:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788211735.791249:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788211735.791255:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660830976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.791280:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660830976:12345-0@lo:400:kworker.0 Request processed in 25us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211735.791286:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788211735.791296:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788211735.791302:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660830720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.791328:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660830720:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211735.791334:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788211735.793582:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660831104 00000100:00100000:0.0:1788211735.793597:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660831104 00000100:00100000:0.0:1788211735.793683:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660830848 00000100:00100000:0.0:1788211735.793686:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660830848 00000100:00100000:0.0:1788211735.794124:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788211735.794137:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660831104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.794289:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660831104:12345-0@lo:400:kworker.0 Request processed in 155us (4014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211735.794297:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788211735.794316:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788211735.794322:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660830848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.794425:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660830848:12345-0@lo:400:kworker.0 Request processed in 31us (3343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211735.794432:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788211735.803274:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660830464 00000100:00100000:1.0:1788211735.803295:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660830464 00000100:00100000:1.0:1788211735.803395:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788211735.803407:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660830464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211735.803539:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660830464:12345-0@lo:400:kworker.0 Request processed in 134us (13194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211735.803547:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:3.0:1788211735.805721:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788211735.805729:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211735.810743:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660830464:0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.810770:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660830976:0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.810786:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660830592:0@lo:400:kworker.0 00010000:00080000:0.0:1788211735.810802:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe092a00 x1875075660831104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211735.810813:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660831104:0@lo:400:kworker.0 00010000:00080000:0.0:1788211735.810883:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe090380 x1875075660830848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211735.810894:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660830848:0@lo:400:kworker.0 00000100:00100000:0.0:1788211735.810908:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660830720:0@lo:400:kworker.0 00000004:00080000:2.0:1788211736.293645:0:7940:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325599474545ns, next at 326599470785ns, rc = 0 00000100:00100000:0.0:1788211736.293769:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660831232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788211736.293899:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211736.303244:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660831232 00000100:00100000:2.0:1788211736.303269:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660831232 00000100:00100000:2.0:1788211736.312959:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788211736.312980:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660831232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211736.314263:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211736.314389:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660831232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1410us (20486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211736.314400:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788211736.315355:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef8a0e00 x1875075660831232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211736.315382:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660831232:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788211736.383451:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788211736.383711:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:3.0:1788211736.383743:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:1.0:1788211736.383945:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211736.383972:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660831360:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788211736.384077:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211736.384146:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660831360 00000100:00100000:1.0:1788211736.384155:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660831360 00000100:00100000:1.0:1788211736.384231:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788211736.384240:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660831360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788211736.384284:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788211736.384327:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a95f212, atime: 0x6a95f212, ctime: 0x6a95f212, blocks: 0x1 00010000:00010000:1.0:1788211736.384336:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b58617/0x2afbce82f55a574c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211736.384352:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=325s v=(0 0) 00010000:00010000:1.0:1788211736.384357:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211736.384363:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b58617/0x2afbce82f55a574c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211736.384380:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1b58617/0x2afbce82f55a574c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211736.384390:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b58617/0x2afbce82f55a574c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211736.384396:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b58617/0x2afbce82f55a574c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211736.384440:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788211736.390192:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875075660831360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5920us (6082us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788211736.390208:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788211736.390254:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788211736.392332:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1b58617/0x2afbce82f55a574c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211736.392349:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788211736.392355:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b58617/0x2afbce82f55a574c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211736.392368:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b58617/0x2afbce82f55a574c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211736.392393:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1b58617/0x2afbce82f55a574c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211736.392401:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b58617/0x2afbce82f55a574c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211736.392567:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211736.392569:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211736.392571:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788211736.392643:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abfca8c9180/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788211736.392654:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660831360:0@lo:6:osp-syn-1-0.0 00000001:02000400:0.0:1788211736.574005:0:11625:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788211736.745761:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211736.796074:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211736.796122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211736.796151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211736.796198:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211736.796227:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637728896 00000100:00100000:0.0:1788211736.796239:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637728896 00000100:00100000:0.0:1788211736.796304:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637729152 00000100:00100000:0.0:1788211736.796307:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637729152 00000100:00100000:0.0:1788211736.796335:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 113 00000100:00100000:0.0:1788211736.796346:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637728896:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211736.796452:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637728896:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 108us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211736.796569:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 113 00000100:00100000:0.0:1788211736.796588:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 114 00000100:00100000:0.0:1788211736.796595:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2359:x1875075637729152:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211736.796620:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2359:x1875075637729152:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211736.796626:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 114 00000100:00100000:2.0:1788211736.796954:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637728768 00000100:00100000:2.0:1788211736.796959:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637728768 00000100:00100000:2.0:1788211736.797004:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 252 00000100:00100000:2.0:1788211736.797013:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637728768:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211736.797051:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637728768:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 40us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211736.797057:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 252 00000100:00100000:2.0:1788211736.797211:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637729024 00000100:00100000:2.0:1788211736.797216:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637729024 00000100:00100000:2.0:1788211736.797250:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:2.0:1788211736.797257:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637729024:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211736.797290:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637729024:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 33us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211736.797297:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00080000:2.0:1788211736.814466:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788211736.814478:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788211737.765765:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788211737.880634:0:11673:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3b85af20 20000000:00000080:3.0:1788211737.880652:0:11673:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8abec6232c00 uarg=0000000000000000 20000000:01000000:3.0:1788211737.880692:0:11673:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788211737.880698:0:11673:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788211737.880702:0:11673:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788211737.881706:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788211737.881879:0:11673:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788211737.888148:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788211737.890047:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788211737.890139:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788211737.890161:0:11673:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788211737.892838:0:11673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211737.892867:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfd2b07600/0x2afbce82f55a55f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a55ee expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211737.892890:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a5603 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a55fc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211737.892897:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abffdb81800/0x2afbce82f55a5611 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a560a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211737.892906:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a5618 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57b7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211737.892913:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a561f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57be expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211737.892920:0:11673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211737.893629:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a561f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57be expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211737.893646:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a561f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57be expref: 12 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211737.893664:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875075660831488:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211737.893780:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a5618 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57b7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211737.893788:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a5618 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57b7 expref: 12 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211737.893796:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875075660831616:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211737.893844:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abffdb81800/0x2afbce82f55a5611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a560a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211737.893853:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abffdb81800/0x2afbce82f55a5611 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a560a expref: 18 pid: 5835 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211737.893862:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875075660831744:0@lo:104: 00000100:00100000:2.0:1788211737.893903:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788211737.893941:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a5603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a55fc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211737.893949:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a5603 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a55fc expref: 18 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211737.893966:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875075660831872:0@lo:104: 00000100:00100000:2.0:1788211737.893988:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788211737.894012:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfd2b07600/0x2afbce82f55a55f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a55ee expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211737.894020:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8abfd2b07600/0x2afbce82f55a55f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a55ee expref: 18 pid: 5835 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211737.894026:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875075660832000:0@lo:104: 00000100:00100000:2.0:1788211737.894046:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211737.894080:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788211737.894093:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660831744 00000100:00100000:2.0:1788211737.894100:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660831744 00000100:00100000:2.0:1788211737.894139:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660831872 00000100:00100000:2.0:1788211737.894143:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660831872 00000100:00100000:2.0:1788211737.894154:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660832000 00000100:00100000:2.0:1788211737.894156:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660832000 00000100:00100000:2.0:1788211737.894193:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788211737.894212:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+5:11673:x1875075660831744:12345-0@lo:104: 00010000:00010000:2.0:1788211737.894333:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5611 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211737.894380:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788211737.894387:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+5:11673:x1875075660831744:12345-0@lo:104: Request processed in 177us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211737.894394:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788211737.894414:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788211737.894421:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+4:11673:x1875075660831872:12345-0@lo:104: 00010000:00010000:2.0:1788211737.894435:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5603 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211737.894467:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788211737.894471:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+4:11673:x1875075660831872:12345-0@lo:104: Request processed in 52us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211737.894477:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788211737.894493:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788211737.894499:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+3:11673:x1875075660832000:12345-0@lo:104: 00010000:00010000:2.0:1788211737.894507:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a55f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211737.894533:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788211737.894539:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afe7852e-b478-4e21-8864-7e739fb0a137+3:11673:x1875075660832000:12345-0@lo:104: Request processed in 41us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211737.894544:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788211737.894587:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788211737.894611:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875075660831744:0@lo:104: 00000100:00100000:2.0:1788211737.894619:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875075660831872:0@lo:104: 00000100:00100000:2.0:1788211737.894626:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875075660832000:0@lo:104: 00010000:00010000:0.0:1788211737.894759:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788211737.894768:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5611 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.894783:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063a00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211737.894788:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a5611 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.894797:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a5611 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211737.894806:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a5611 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211737.894825:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788211737.894868:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5611 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.894875:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211737.894899:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5611 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.894906:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a560a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5611 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.894921:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788211737.894924:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a5603 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.894931:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030a00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211737.894934:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a5603 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.894952:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a5603 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211737.894958:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a5603 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211737.894963:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788211737.894979:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5603 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.894984:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211737.894990:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5603 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.894995:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc0030a00/0x2afbce82f55a55fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a5603 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895005:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211737.895008:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a55f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895013:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0031a00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211737.895015:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a55f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895021:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a55f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211737.895028:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a55f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211737.895039:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788211737.895055:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a55f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895060:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211737.895077:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a55f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895082:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc0031a00/0x2afbce82f55a55ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a55f5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895096:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211737.895099:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211737.895100:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211737.895208:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660832128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211737.895262:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211737.895302:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788211737.895308:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660832256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211737.895329:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211737.895354:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788211737.895362:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660832384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211737.895385:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211737.895410:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660832128 00000100:00100000:0.0:1788211737.895415:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660832128 00010000:00010000:0.0:1788211737.895438:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abffdb81800/0x2afbce82f55a5611 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a560a expref: 19 pid: 5835 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211737.895457:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660832256 00000100:00100000:0.0:1788211737.895464:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660832256 00010000:00010000:0.0:1788211737.895477:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a5603 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a55fc expref: 20 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211737.895487:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660832384 00000100:00100000:0.0:1788211737.895488:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660832384 00010000:00010000:0.0:1788211737.895497:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfd2b07600/0x2afbce82f55a55f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a55ee expref: 21 pid: 5835 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211737.895509:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788211737.895516:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+21:3310:x1875075660832128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788211737.895529:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211737.895536:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abffdb81800/0x2afbce82f55a5611 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a560a expref: 21 pid: 5835 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895546:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abffdb81800/0x2afbce82f55a5611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a560a expref: 21 pid: 5835 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895562:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb81800/0x2afbce82f55a5611 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a560a expref: 21 pid: 5835 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895579:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211737.895611:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+20:3310:x1875075660832128:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211737.895618:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788211737.895631:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788211737.895637:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660832256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788211737.895645:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211737.895649:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a5603 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a55fc expref: 19 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895667:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a5603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a55fc expref: 19 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895678:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a5603 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a55fc expref: 19 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895687:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211737.895709:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+18:3310:x1875075660832256:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211737.895716:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788211737.895729:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788211737.895735:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+17:3309:x1875075660832384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788211737.895743:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211737.895747:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfd2b07600/0x2afbce82f55a55f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a55ee expref: 17 pid: 5835 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895755:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfd2b07600/0x2afbce82f55a55f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a55ee expref: 17 pid: 5835 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895764:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b07600/0x2afbce82f55a55f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a55ee expref: 17 pid: 5835 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.895772:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211737.895795:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe7852e-b478-4e21-8864-7e739fb0a137+16:3309:x1875075660832384:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211737.895801:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788211737.895884:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660832384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211737.895907:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660832256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211737.895922:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660832128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788211737.896742:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211737.900675:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875075660831488:192.168.204.29@tcp:104: 00000100:00100000:3.0:1788211737.900691:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875075660831616:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211737.900728:0:11673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211737.900825:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211737.900856:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211737.900920:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637729280 00000100:00100000:0.0:1788211737.900928:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637729280 00010000:00010000:0.0:1788211737.900970:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a561f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57be expref: 13 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211737.901018:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637729408 00000100:00100000:0.0:1788211737.901022:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637729408 00010000:00010000:0.0:1788211737.901035:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a5618 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57b7 expref: 14 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211737.901052:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:0.0:1788211737.901061:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+14:2359:x1875075637729280:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211737.901076:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211737.901083:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a561f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57be expref: 14 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901096:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a561f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57be expref: 14 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901116:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a561f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57be expref: 14 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901133:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211737.901240:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637729280:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 179us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211737.901248:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:0.0:1788211737.901268:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:0.0:1788211737.901294:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:2359:x1875075637729408:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211737.901302:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211737.901307:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a5618 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57b7 expref: 12 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901316:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a5618 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57b7 expref: 12 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901327:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a5618 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f57b7 expref: 12 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901339:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901348:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901363:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901370:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901377:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901384:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901392:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211737.901396:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901412:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901426:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211737.901435:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211737.901452:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:2359:x1875075637729408:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 160us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211737.901459:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00010000:00010000:3.0:1788211737.901927:0:11673:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211737.901937:0:11673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211737.901944:0:11673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6063200/0x2afbce82f55a5753 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211738.790637:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788211739.685364:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788211739.685379:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfcaf32000 from 7 10000000:01000000:2.0:1788211739.685388:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788211739.685469:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211739.685526:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211739.685544:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211739.686792:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660832512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788211739.686969:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211739.687113:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788211739.692290:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660832512 00000100:00100000:0.0:1788211739.692309:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660832512 00000100:00100000:0.0:1788211739.692385:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788211739.692397:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+16:5840:x1875075660832512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211739.692421:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211739.692448:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfca8cc400/0x2afbce82f55a5761 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a575a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211739.692483:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfca8cc400/0x2afbce82f55a5761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a575a expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211739.692496:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfca8cc400/0x2afbce82f55a5761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a575a expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211739.692509:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc400, rc 0) 00000100:00100000:0.0:1788211739.692723:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660832512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 328us (5754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211739.692750:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788211739.701974:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660832512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788211739.702030:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211739.702048:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211739.707071:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660832640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211739.707598:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211739.708127:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660832640 00000100:00100000:0.0:1788211739.708150:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660832640 00000100:00100000:3.0:1788211739.708554:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788211739.709075:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788211739.709090:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660832640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211739.709767:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660832640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 675us (2594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211739.709788:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788211739.711044:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660832640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211739.711123:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660832768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788211739.711242:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211739.719488:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788211739.725566:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660832768 00000100:00100000:0.0:1788211739.725583:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660832768 00000100:00100000:0.0:1788211739.725636:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788211739.725645:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd87aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660832768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211739.725960:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd87aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660832768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 315us (14718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211739.725969:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788211739.727095:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660832768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788211739.728926:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:11686:1875075660832896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211739.729029:0:11686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211739.729089:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788211739.729496:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660832896 00000100:00100000:0.0:1788211739.729509:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660832896 00000100:00100000:0.0:1788211739.729569:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788211739.729579:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc923a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:11686:x1875075660832896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211739.729884:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc923a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+17:11686:x1875075660832896:12345-0@lo:502:llog_process_th.0 Request processed in 303us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211739.729892:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788211739.730414:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:11686:1875075660832896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788211739.730464:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788211739.730481:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211739.730484:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788211739.730493:0:11686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8abfcaf32000 00000020:00000080:3.0:1788211739.730496:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788211739.730603:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:11686:1875075660833024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211739.730649:0:11686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211739.730681:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788211739.731974:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660833024 00000100:00100000:2.0:1788211739.731985:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660833024 00000100:00100000:2.0:1788211739.732049:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788211739.732060:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+17:11686:x1875075660833024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211739.732659:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+17:11686:x1875075660833024:12345-0@lo:502:llog_process_th.0 Request processed in 599us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.732669:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788211739.733615:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:11686:1875075660833024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788211739.733662:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211739.733671:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211739.733674:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788211739.733678:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788211739.735048:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788211739.735087:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788211739.735099:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211739.735113:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211739.735123:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788211739.735126:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ac001fd6800 from 7 10000000:01000000:1.0:1788211739.735129:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788211739.735415:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211739.735425:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211739.735437:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211739.735469:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660833152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788211739.735566:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211739.735626:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6631900 going to sleep for 11 seconds 00000100:00100000:2.0:1788211739.735975:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660833152 00000100:00100000:2.0:1788211739.735983:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660833152 00000100:00100000:2.0:1788211739.737954:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788211739.737977:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+17:5840:x1875075660833152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788211739.738228:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211739.738253:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abffdb81000/0x2afbce82f55a576f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5768 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211739.738290:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb81000/0x2afbce82f55a576f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5768 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211739.738315:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abffdb81000/0x2afbce82f55a576f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5768 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211739.738325:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81000, rc 0) 00000100:00100000:2.0:1788211739.738426:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660833152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 458us (2858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.738433:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788211739.740314:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660833152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211739.740353:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211739.740385:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211739.740514:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660833280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211739.740590:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211739.740968:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211739.741027:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660833280 00000100:00100000:2.0:1788211739.741035:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660833280 00000100:00100000:2.0:1788211739.741102:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788211739.741114:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc923bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660833280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211739.742625:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc923bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660833280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1506us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.742636:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788211739.742767:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660833280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211739.742925:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660833408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211739.742977:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211739.743012:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211739.743935:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660833408 00000100:00100000:2.0:1788211739.743945:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660833408 00000100:00100000:2.0:1788211739.743998:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788211739.744007:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc923b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660833408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211739.744603:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc923b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660833408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 595us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.744611:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788211739.746082:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660833408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788211739.758637:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:11689:1875075660833536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211739.758767:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211739.758851:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211739.759461:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660833536 00000100:00100000:2.0:1788211739.759475:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660833536 00000100:00100000:2.0:1788211739.759540:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788211739.759553:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+18:11689:x1875075660833536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211739.759911:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+18:11689:x1875075660833536:12345-0@lo:502:llog_process_th.0 Request processed in 358us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.759918:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788211739.760127:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:11689:1875075660833536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788211739.760163:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788211739.760264:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211739.760266:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788211739.760275:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac001fd6800 00000020:00000080:3.0:1788211739.760278:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788211739.760389:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:11689:1875075660833664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211739.760436:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211739.760456:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211739.762358:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660833664 00000100:00100000:2.0:1788211739.762377:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660833664 00000100:00100000:2.0:1788211739.762451:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788211739.762463:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:11689:x1875075660833664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211739.762976:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:11689:1875075660833664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788211739.763017:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211739.763027:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211739.763030:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788211739.763036:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:2.0:1788211739.763793:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9238c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+18:11689:x1875075660833664:12345-0@lo:502:llog_process_th.0 Request processed in 351us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.763807:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:01000000:1.0:1788211739.764019:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788211739.764047:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788211739.764058:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211739.764084:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211739.764097:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788211739.764100:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfc288e800 from 7 10000000:01000000:1.0:1788211739.764103:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788211739.764141:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211739.764149:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211739.764158:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211739.764439:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660833792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788211739.764505:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211739.764537:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6631b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788211739.765060:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660833792 00000100:00100000:3.0:1788211739.765070:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660833792 00000100:00100000:3.0:1788211739.765265:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788211739.765277:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+18:5840:x1875075660833792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788211739.765294:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211739.765309:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6063200/0x2afbce82f55a577d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a5776 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211739.765333:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6063200/0x2afbce82f55a577d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a5776 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211739.765342:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6063200/0x2afbce82f55a577d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a5776 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211739.765352:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063200, rc 0) 00000100:00100000:3.0:1788211739.765413:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9238450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660833792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211739.765421:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788211739.765548:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660833792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788211739.765565:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211739.765640:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211739.765793:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660833920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211739.766498:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211739.766531:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211739.767465:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660833920 00000100:00100000:3.0:1788211739.767483:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660833920 00000100:00100000:3.0:1788211739.767566:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788211739.770053:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660833920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211739.770428:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:5840:x1875075660833920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 391us (3931us total) trans 0 rc 0/0 00000040:00080000:0.0:1788211739.772607:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788211739.777626:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660833920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211739.777720:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660834048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211739.778807:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211739.778978:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211739.779007:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660834048 00000100:00100000:2.0:1788211739.779040:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660834048 00000100:00100000:2.0:1788211739.779088:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788211739.779097:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+20:5840:x1875075660834048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211739.782409:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+20:5840:x1875075660834048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3302us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.782427:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788211739.782709:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afe7852e-b478-4e21-8864-7e739fb0a137:5840:1875075660834048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788211739.783493:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:11691:1875075660834176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788211739.783649:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211739.783761:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660834176 00000100:00100000:1.0:1788211739.783768:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660834176 00000100:00100000:1.0:1788211739.784113:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788211739.784127:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+20:11691:x1875075660834176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211739.784325:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6631b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788211739.784490:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788211739.786734:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:11691:x1875075660834176:12345-0@lo:502:llog_process_th.0 Request processed in 2598us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211739.786750:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788211739.790548:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:11691:1875075660834176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788211739.790617:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211739.790634:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211739.790637:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788211739.790646:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8abfc288e800 00000020:00000080:2.0:1788211739.790650:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788211739.790760:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:11691:1875075660834304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211739.791093:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211739.791155:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788211739.792455:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660834304 00000100:00100000:3.0:1788211739.792473:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660834304 00000100:00100000:3.0:1788211739.792548:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788211739.792560:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:11691:x1875075660834304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211739.794756:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:11691:x1875075660834304:12345-0@lo:502:llog_process_th.0 Request processed in 2182us (3649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211739.794809:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788211739.796056:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afe7852e-b478-4e21-8864-7e739fb0a137:11691:1875075660834304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788211739.796103:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211739.796112:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211739.796114:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788211739.796120:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788211739.796696:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788211739.796721:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788211739.796731:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211739.796743:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211739.827877:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211739.929211:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211739.929267:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637729536 00000100:00100000:0.0:1788211739.929280:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637729536 00000100:00100000:0.0:1788211739.929350:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 268 00000100:00100000:0.0:1788211739.929362:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:5602:x1875075637729536:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211739.929379:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211739.929398:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfca8cc200/0x2afbce82f55a5784 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f580b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211739.929427:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfca8cc200/0x2afbce82f55a5784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f580b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211739.929439:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfca8cc200/0x2afbce82f55a5784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f580b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211739.929449:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc200, rc 0) 00000100:00100000:0.0:1788211739.929521:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:5602:x1875075637729536:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 162us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211739.929529:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 268 00000100:00100000:0.0:1788211739.934968:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211739.935062:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637729664 00000100:00100000:3.0:1788211739.935077:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637729664 00000100:00100000:3.0:1788211739.935155:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 269 00000100:00100000:3.0:1788211739.935221:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:5602:x1875075637729664:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211739.935632:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:5602:x1875075637729664:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 464us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.935642:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 269 00000100:00100000:3.0:1788211739.937435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211739.938278:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637729792 00000100:00100000:2.0:1788211739.938287:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637729792 00000100:00100000:2.0:1788211739.938345:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 270 00000100:00100000:2.0:1788211739.938371:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:5602:x1875075637729792:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211739.938628:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:5602:x1875075637729792:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 259us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.938637:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 270 00000100:00100000:1.0:1788211739.944710:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211739.944994:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637729920 00000100:00100000:2.0:1788211739.945005:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637729920 00000100:00100000:2.0:1788211739.945066:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 271 00000100:00100000:2.0:1788211739.945076:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:9969:x1875075637729920:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788211739.945564:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:9969:x1875075637729920:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 487us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.945574:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 271 00000100:00100000:1.0:1788211739.952351:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211739.952462:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637730048 00000100:00100000:0.0:1788211739.952473:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637730048 00000100:00100000:0.0:1788211739.952539:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 272 00000100:00100000:0.0:1788211739.952550:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:9969:x1875075637730048:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788211739.952827:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:9969:x1875075637730048:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 278us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211739.952836:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 272 00000100:00100000:0.0:1788211739.960254:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211739.960318:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637730176 00000100:00100000:3.0:1788211739.960331:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637730176 00000100:00100000:2.0:1788211739.960555:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 273 00000100:00100000:2.0:1788211739.960567:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:5602:x1875075637730176:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788211739.960585:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211739.960604:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abffdb81400/0x2afbce82f55a578b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5812 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211739.960641:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb81400/0x2afbce82f55a578b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5812 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211739.960654:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abffdb81400/0x2afbce82f55a578b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5812 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211739.960666:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81400, rc 0) 00000100:00100000:2.0:1788211739.960745:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:5602:x1875075637730176:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 180us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.960784:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 273 00000100:00100000:1.0:1788211739.972154:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211739.972360:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637730304 00000100:00100000:2.0:1788211739.972372:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637730304 00000100:00100000:2.0:1788211739.972436:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 274 00000100:00100000:2.0:1788211739.972445:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:5602:x1875075637730304:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211739.972816:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:5602:x1875075637730304:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 370us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.972825:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 274 00000100:00100000:1.0:1788211739.980538:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211739.980633:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637730432 00000100:00100000:0.0:1788211739.980645:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637730432 00000100:00100000:0.0:1788211739.980711:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 275 00000100:00100000:0.0:1788211739.980723:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:5602:x1875075637730432:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211739.981035:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:5602:x1875075637730432:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 313us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211739.981044:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 275 00000100:00100000:3.0:1788211739.986400:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211739.986901:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637730560 00000100:00100000:0.0:1788211739.986915:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637730560 00000100:00100000:0.0:1788211739.987003:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 276 00000100:00100000:0.0:1788211739.987023:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:9972:x1875075637730560:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788211739.987649:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:9972:x1875075637730560:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 624us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211739.987660:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 276 00000100:00100000:1.0:1788211739.990509:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211739.990618:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637730688 00000100:00100000:2.0:1788211739.990633:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637730688 00000100:00100000:2.0:1788211739.990707:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 277 00000100:00100000:2.0:1788211739.990722:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:9972:x1875075637730688:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788211739.991437:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:9972:x1875075637730688:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 714us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211739.991449:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 277 00000100:00100000:0.0:1788211740.389557:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660834432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211740.389659:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211740.389893:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660834432 00000100:00100000:2.0:1788211740.389903:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660834432 00000100:00080000:3.0:1788211740.389990:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788211740.389990:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788211740.390003:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660834432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788211740.390052:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211740.395548:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660834432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5531us (5872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211740.396619:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788211740.398447:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe07ed80 x1875075660834432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211740.398479:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660834432:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788211740.837982:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788211740.839150:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211740.901814:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660834560:0@lo:400:kworker.0 00000100:00100000:0.0:1788211740.901933:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211740.901994:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660835072:0@lo:400:kworker.0 00000100:00100000:0.0:1788211740.902044:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211740.902076:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788211740.902083:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660834688:0@lo:400:kworker.0 00000100:00100000:0.0:1788211740.902107:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211740.902124:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660835200:0@lo:400:kworker.0 00000100:00100000:0.0:1788211740.902150:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211740.902204:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660835072 00000100:00100000:0.0:1788211740.902213:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660835072 00000100:00100000:0.0:1788211740.902268:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660834688 00000100:00100000:0.0:1788211740.902271:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660834688 00000100:00100000:0.0:1788211740.902294:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788211740.902303:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660835072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211740.902362:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660835072:12345-0@lo:400:kworker.0 Request processed in 60us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211740.902372:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788211740.902393:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788211740.902400:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660834688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211740.902427:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660834688:12345-0@lo:400:kworker.0 Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211740.902433:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788211740.902461:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660835200 00000100:00100000:0.0:1788211740.902464:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660835200 00000100:00100000:0.0:1788211740.902494:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788211740.902501:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660835200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211740.902532:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660835200:12345-0@lo:400:kworker.0 Request processed in 31us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211740.902538:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788211740.902572:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788211740.902578:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211740.902612:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660834688:0@lo:400:kworker.0 00000100:00100000:0.0:1788211740.902624:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660835200:0@lo:400:kworker.0 00000100:00100000:0.0:1788211740.902633:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660835072:0@lo:400:kworker.0 00000100:00100000:0.0:1788211740.902659:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660834944:0@lo:400:kworker.0 00000100:00100000:0.0:1788211740.902686:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211740.902711:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788211740.902716:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660834816:0@lo:400:kworker.0 00000100:00100000:0.0:1788211740.902739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211740.902925:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660834944 00000100:00100000:2.0:1788211740.902937:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660834944 00000100:00100000:2.0:1788211740.902975:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788211740.902982:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660834944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211740.903028:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660834944:12345-0@lo:400:kworker.0 Request processed in 47us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211740.903034:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788211740.903053:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660834816 00000100:00100000:2.0:1788211740.903056:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660834816 00000100:00100000:2.0:1788211740.903085:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788211740.903091:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660834816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211740.903121:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660834816:12345-0@lo:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211740.903127:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1788211740.903145:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211740.903184:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660834816:0@lo:400:kworker.0 00010000:00080000:2.0:1788211740.903199:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe07d180 x1875075660834944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211740.903209:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660834944:0@lo:400:kworker.0 00000100:00100000:3.0:1788211740.903811:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660834560 00000100:00100000:3.0:1788211740.903819:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660834560 00000100:00100000:3.0:1788211740.903866:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788211740.903874:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660834560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211740.903947:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660834560:12345-0@lo:400:kworker.0 Request processed in 74us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211740.903953:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788211740.907267:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660834560:0@lo:400:kworker.0 00000100:00100000:2.0:1788211741.416045:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660835328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211741.416136:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211741.418678:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660835328 00000100:00100000:2.0:1788211741.418692:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660835328 00000100:00100000:2.0:1788211741.418763:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788211741.418777:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875075660835328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211741.418829:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211741.418935:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875075660835328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (2799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211741.418957:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788211741.419022:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660835328:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788211741.507995:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1788211741.861680:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211741.914683:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211741.914726:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211741.914779:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211741.914817:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211741.914855:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637731072 00000100:00100000:1.0:1788211741.914865:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637731072 00000100:00100000:1.0:1788211741.914934:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:1.0:1788211741.914945:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637731072:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211741.915022:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637731072:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211741.915030:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00080000:1.0:1788211741.915058:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788211741.915322:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637730944 00000100:00100000:0.0:1788211741.915328:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637730944 00000100:00100000:0.0:1788211741.915372:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637731200 00000100:00100000:0.0:1788211741.915376:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637731200 00000100:00100000:0.0:1788211741.915402:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:0.0:1788211741.915410:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637730944:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211741.915455:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637730944:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 45us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211741.915461:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:0.0:1788211741.915478:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 119 00000100:00100000:0.0:1788211741.915484:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637731200:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211741.915506:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637731200:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 23us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211741.915536:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 119 00000100:00100000:3.0:1788211741.915824:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637730816 00000100:00100000:3.0:1788211741.915830:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637730816 00000100:00100000:3.0:1788211741.915872:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 279 00000100:00100000:3.0:1788211741.915924:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca83e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637730816:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211741.915967:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca83e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637730816:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 87us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211741.915974:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 279 00000100:00080000:1.0:1788211741.916243:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788211742.885778:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211743.914475:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211744.934056:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211745.509815:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660835456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788211745.509913:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211745.510107:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660835456 00000100:00100000:3.0:1788211745.510128:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660835456 00000100:00080000:1.0:1788211745.510189:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788211745.510236:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788211745.510247:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660835456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788211745.510290:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211745.510351:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660835456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211745.510359:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788211745.510459:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe07e300 x1875075660835456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211745.510479:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660835456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788211745.957548:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211746.021860:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660835712:0@lo:400:kworker.0 00000100:00100000:0.0:1788211746.021947:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211746.022120:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660835584:0@lo:400:kworker.0 00000100:00100000:3.0:1788211746.022184:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211746.022410:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660836224:0@lo:400:kworker.0 00000100:00100000:0.0:1788211746.022446:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211746.022544:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660835968:0@lo:400:kworker.0 00000100:00100000:1.0:1788211746.022579:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211746.025754:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660835712 00000100:00100000:2.0:1788211746.025783:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660835712 00000100:00100000:2.0:1788211746.025865:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788211746.025875:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660835712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211746.025972:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660835712:12345-0@lo:400:kworker.0 Request processed in 98us (4026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211746.025979:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788211746.026029:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660835584 00000100:00100000:2.0:1788211746.026033:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660835584 00000100:00100000:2.0:1788211746.026377:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788211746.026387:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660835584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211746.026504:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660835584:12345-0@lo:400:kworker.0 Request processed in 119us (4319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211746.026512:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788211746.028681:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660835712:0@lo:400:kworker.0 00000100:00100000:0.0:1788211746.028810:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660836224 00000100:00100000:0.0:1788211746.028959:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660836224 00000100:00100000:0.0:1788211746.029264:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660835968 00000100:00100000:0.0:1788211746.029269:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660835968 00000100:00100000:0.0:1788211746.029310:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788211746.029322:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660836224:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788211746.029746:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788211746.029850:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788211746.029868:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660836224:12345-0@lo:400:kworker.0 Request processed in 546us (7419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211746.029886:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660835840:0@lo:400:kworker.0 00000100:00100000:1.0:1788211746.029943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211746.030127:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788211746.030138:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660835968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211746.030216:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788211746.030257:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660835840 00000100:00100000:0.0:1788211746.030263:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660835840 00000100:00100000:0.0:1788211746.030303:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788211746.030311:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660835840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211746.030422:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660835968:12345-0@lo:400:kworker.0 Request processed in 287us (7841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211746.030430:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788211746.030483:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffdb91f80 x1875075660835968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211746.030495:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660835968:0@lo:400:kworker.0 00000100:00080000:1.0:1788211746.030527:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211746.030548:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788211746.030553:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abfca8c9180, transno 4294967300 00000100:00100000:1.0:1788211746.030565:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660836224:0@lo:400:kworker.0 00000100:00100000:0.0:1788211746.030986:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660835840:12345-0@lo:400:kworker.0 Request processed in 674us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211746.030997:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788211746.031122:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660835584:0@lo:400:kworker.0 00000100:00100000:3.0:1788211746.031133:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660836096:0@lo:400:kworker.0 00000100:00100000:3.0:1788211746.031310:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211746.031468:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660836096 00000100:00100000:0.0:1788211746.031473:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660836096 00000100:00100000:0.0:1788211746.031583:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788211746.031591:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660836096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211746.031640:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660836096:12345-0@lo:400:kworker.0 Request processed in 49us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211746.031646:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788211746.032355:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660835840:0@lo:400:kworker.0 00000100:00100000:2.0:1788211746.032563:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660836096:0@lo:400:kworker.0 00000100:00080000:3.0:1788211746.035595:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211746.534708:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660836352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211746.534793:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211746.534882:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660836352 00000100:00100000:2.0:1788211746.534892:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660836352 00000100:00100000:2.0:1788211746.534953:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788211746.534964:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660836352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211746.535005:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211746.535053:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660836352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211746.535071:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788211746.535267:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660836352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788211746.981642:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211747.034624:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211747.034688:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211747.034733:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211747.034773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211747.034889:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637731456 00000100:00100000:0.0:1788211747.034907:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637731456 00000100:00100000:0.0:1788211747.035008:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637731712 00000100:00100000:0.0:1788211747.035012:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637731712 00000100:00100000:0.0:1788211747.035041:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 123 00000100:00100000:0.0:1788211747.035060:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637731456:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211747.035162:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637731456:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 112us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211747.035205:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 123 00000100:00100000:0.0:1788211747.035226:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 124 00000100:00100000:0.0:1788211747.035232:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637731712:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211747.035258:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637731712:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211747.035264:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 124 00000100:00100000:0.0:1788211747.035286:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637731584 00000100:00100000:0.0:1788211747.035289:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637731584 00000100:00100000:0.0:1788211747.035318:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:0.0:1788211747.035325:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637731584:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211747.035375:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637731584:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 51us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211747.035382:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:3.0:1788211747.035838:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637731328 00000100:00100000:3.0:1788211747.035844:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637731328 00000100:00100000:3.0:1788211747.035894:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 281 00000100:00100000:3.0:1788211747.035902:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2358:x1875075637731328:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211747.035936:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2358:x1875075637731328:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 35us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211747.035943:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 281 00000100:00080000:1.0:1788211747.036669:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211747.036676:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788211748.005413:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211749.029512:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211750.054667:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788211750.056137:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788211750.629759:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211750.632662:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660836480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211750.632759:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211750.634238:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660836480 00000100:00100000:2.0:1788211750.634251:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660836480 00000100:00100000:2.0:1788211750.634340:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788211750.634353:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660836480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788211750.634405:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211750.634507:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660836480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211750.634514:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788211750.634769:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788211750.634901:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe07d180 x1875075660836480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211750.634926:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660836480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788211751.078825:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211751.141906:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660836992:0@lo:400:kworker.0 00000100:00100000:1.0:1788211751.141995:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211751.142075:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788211751.142081:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660836864:0@lo:400:kworker.0 00000100:00100000:1.0:1788211751.142110:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211751.142145:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660836992 00000100:00100000:1.0:1788211751.142152:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660836992 00000100:00100000:1.0:1788211751.142237:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788211751.142247:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660836992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211751.142303:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660836992:12345-0@lo:400:kworker.0 Request processed in 57us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211751.142311:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788211751.142355:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffdb91f80 x1875075660836992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788211767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211751.142367:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660836992:0@lo:400:kworker.0 00000100:00100000:2.0:1788211751.142575:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660836608:0@lo:400:kworker.0 00000100:00100000:2.0:1788211751.142614:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211751.142648:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660837120:0@lo:400:kworker.0 00000100:00100000:2.0:1788211751.142673:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211751.142701:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788211751.142707:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660836736:0@lo:400:kworker.0 00000100:00100000:2.0:1788211751.142731:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211751.142755:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660837248:0@lo:400:kworker.0 00000100:00100000:2.0:1788211751.142775:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211751.142839:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660836608 00000100:00100000:3.0:1788211751.142843:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660836608 00000100:00100000:3.0:1788211751.142879:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788211751.142886:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660836608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211751.142928:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660836608:12345-0@lo:400:kworker.0 Request processed in 43us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211751.142947:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788211751.143023:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660836608:0@lo:400:kworker.0 00000100:00100000:0.0:1788211751.143097:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660836864 00000100:00100000:0.0:1788211751.143102:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660836864 00000100:00100000:0.0:1788211751.143151:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660837120 00000100:00100000:0.0:1788211751.143154:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660837120 00000100:00100000:0.0:1788211751.143207:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660836736 00000100:00100000:0.0:1788211751.143210:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660836736 00000100:00100000:0.0:1788211751.143225:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788211751.143232:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660836864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211751.143272:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660836864:12345-0@lo:400:kworker.0 Request processed in 42us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211751.143278:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788211751.143290:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788211751.143297:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660837120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211751.143326:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660837120:12345-0@lo:400:kworker.0 Request processed in 30us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211751.143332:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788211751.143349:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788211751.143355:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660836736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211751.143380:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660836736:12345-0@lo:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211751.143385:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788211751.143403:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660837248 00000100:00100000:0.0:1788211751.143406:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660837248 00000100:00100000:0.0:1788211751.143427:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788211751.143433:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660837248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211751.143458:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660837248:12345-0@lo:400:kworker.0 Request processed in 25us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211751.143464:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788211751.143596:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788211751.143601:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211751.143664:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660836736:0@lo:400:kworker.0 00000100:00100000:2.0:1788211751.143675:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660837248:0@lo:400:kworker.0 00000100:00100000:2.0:1788211751.143683:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660837120:0@lo:400:kworker.0 00000100:00100000:1.0:1788211751.143864:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660836864:0@lo:400:kworker.0 00000100:00100000:3.0:1788211751.653942:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788211751.653968:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660837376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211751.654058:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211751.654104:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660837376 00000100:00100000:1.0:1788211751.654114:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660837376 00000100:00100000:1.0:1788211751.654206:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788211751.654218:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660837376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788211751.654256:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211751.654309:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660837376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211751.654317:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788211751.654394:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660837376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788211752.104090:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211752.155050:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211752.160988:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211752.162326:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637731968 00000100:00100000:1.0:1788211752.162342:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637731968 00000100:00100000:1.0:1788211752.162448:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 128 00000100:00100000:1.0:1788211752.162461:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637731968:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211752.162559:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637731968:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 101us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211752.162565:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 128 00000100:00080000:3.0:1788211752.164651:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211752.165892:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637731840 00000100:00100000:0.0:1788211752.165907:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637731840 00000100:00100000:0.0:1788211752.166108:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 283 00000100:00100000:0.0:1788211752.166121:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637731840:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211752.166239:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637731840:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 120us (11200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211752.166247:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 283 00000100:00100000:3.0:1788211752.188113:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211752.188208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211752.188673:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637732224 00000100:00100000:0.0:1788211752.188686:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637732224 00000100:00100000:1.0:1788211752.188745:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637732096 00000100:00100000:1.0:1788211752.188751:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637732096 00000100:00080000:3.0:1788211752.188906:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211752.188909:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 129 00000100:00080000:3.0:1788211752.188914:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788211752.188923:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637732224:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211752.188955:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1788211752.188966:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2357:x1875075637732096:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:1.0:1788211752.188992:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a56c7 00000100:00080000:1.0:1788211752.189001:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8abfd87c9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788211752.189094:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788211752.189219:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637732224:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 299us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211752.189229:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 129 00000100:00100000:1.0:1788211752.189423:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+2:2357:x1875075637732096:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 458us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211752.189430:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00010000:00010000:3.0:1788211752.189600:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211753.125583:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211754.149316:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211755.173766:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211755.749660:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660837504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211755.749755:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211755.749919:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660837504 00000100:00100000:3.0:1788211755.749930:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660837504 00000100:00100000:3.0:1788211755.750007:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788211755.750020:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660837504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788211755.750062:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211755.750117:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660837504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211755.750124:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788211755.750221:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe07f100 x1875075660837504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211755.750241:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660837504:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788211755.751253:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788211756.197655:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211756.262505:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660837888:0@lo:400:kworker.0 00000100:00100000:3.0:1788211756.262594:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211756.262605:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660838016:0@lo:400:kworker.0 00000100:00100000:0.0:1788211756.262649:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211756.262701:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660837888 00000100:00100000:0.0:1788211756.262702:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660838016 00000100:00100000:3.0:1788211756.262711:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660837888 00000100:00100000:0.0:1788211756.262711:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660838016 00000100:00100000:1.0:1788211756.262780:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660837760:0@lo:400:kworker.0 00000100:00100000:1.0:1788211756.262822:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211756.262856:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788211756.262862:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660837632:0@lo:400:kworker.0 00000100:00100000:1.0:1788211756.262902:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211756.262923:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660838144:0@lo:400:kworker.0 00000100:00100000:1.0:1788211756.262951:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211756.263006:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660838144 00000100:00100000:1.0:1788211756.263010:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660838144 00000100:00100000:0.0:1788211756.263077:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660837760 00000100:00100000:0.0:1788211756.263081:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660837760 00000100:00100000:2.0:1788211756.263150:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788211756.263218:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788211756.263226:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660838144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211756.263275:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660838144:12345-0@lo:400:kworker.0 Request processed in 51us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211756.263281:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788211756.263319:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660838144:0@lo:400:kworker.0 00000100:00080000:1.0:1788211756.263347:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211756.263351:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211756.265384:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788211756.265419:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660837888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211756.266501:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660837888:12345-0@lo:400:kworker.0 Request processed in 1078us (3897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211756.266514:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788211756.269866:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788211756.269881:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660837760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211756.270111:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660837760:12345-0@lo:400:kworker.0 Request processed in 232us (7287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211756.270118:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788211756.270217:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660837760:0@lo:400:kworker.0 00000100:00100000:0.0:1788211756.270261:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660837632 00000100:00100000:0.0:1788211756.270267:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660837632 00000100:00100000:0.0:1788211756.270295:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788211756.270300:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660837632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211756.270334:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660837632:12345-0@lo:400:kworker.0 Request processed in 34us (7432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211756.270340:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788211756.270447:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660837632:0@lo:400:kworker.0 00000100:00100000:0.0:1788211756.270499:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660837888:0@lo:400:kworker.0 00000100:00100000:2.0:1788211756.270574:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875075660838016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211756.270623:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875075660838016:12345-0@lo:400:kworker.0 Request processed in 7464us (7975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211756.270630:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788211756.270695:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660838016:0@lo:400:kworker.0 00000100:00100000:3.0:1788211756.773811:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788211756.773836:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660838272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211756.773931:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211756.774012:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660838272 00000100:00100000:3.0:1788211756.774020:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660838272 00000100:00100000:3.0:1788211756.774070:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788211756.774077:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660838272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211756.774111:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211756.774152:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660838272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211756.774160:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788211756.774556:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660838272:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788211756.846049:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000020:00000080:2.0:1788211756.846057:0:7655:0:(genops.c:885:class_export_put()) final put ffff8abfd87cf800/a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000020:00000080:1.0:1788211756.846131:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd87cf800/a688ef06-7eb0-4c47-9425-de9843f5c0e0 for lustre-OST0001 00000020:00000080:1.0:1788211756.846200:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfd87c9000 for lustre-OST0001 00010000:00010000:1.0:1788211757.221807:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211757.278118:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211757.278162:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211757.278231:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211757.278341:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637732352 00000100:00100000:0.0:1788211757.278352:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637732352 00000100:00100000:0.0:1788211757.278417:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 285 00000100:00100000:0.0:1788211757.278430:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2358:x1875075637732352:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211757.278535:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2358:x1875075637732352:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 108us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211757.278543:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 285 00000100:00100000:3.0:1788211757.279135:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637732608 00000100:00100000:3.0:1788211757.279142:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637732608 00000100:00100000:3.0:1788211757.279222:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637732480 00000100:00100000:3.0:1788211757.279226:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637732480 00000100:00100000:3.0:1788211757.279255:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 133 00000100:00100000:3.0:1788211757.279263:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637732608:12345-192.168.204.29@tcp:400:kworker.0 00000100:00080000:1.0:1788211757.279413:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211757.279586:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637732608:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 323us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211757.279594:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 133 00000100:00100000:3.0:1788211757.279627:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 134 00000100:00100000:3.0:1788211757.279634:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637732480:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211757.288026:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637732480:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 8341us (9742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211757.288044:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 134 00010000:00010000:3.0:1788211758.246068:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211759.269445:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788211760.297537:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788211760.301879:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211760.870439:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788211760.870477:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660838400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211760.870563:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211760.871049:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660838400 00000100:00100000:2.0:1788211760.871071:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660838400 00000100:00100000:2.0:1788211760.871147:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788211760.871158:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660838400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788211760.871223:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211760.871277:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660838400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211760.871284:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788211760.871323:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffe07c380 x1875075660838400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211760.871342:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660838400:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788211760.873274:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788211761.317475:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211761.382316:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660838784:0@lo:400:kworker.0 00000100:00100000:3.0:1788211761.382431:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211761.382501:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788211761.382508:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660838656:0@lo:400:kworker.0 00000100:00100000:3.0:1788211761.382530:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211761.382559:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660838784 00000100:00100000:3.0:1788211761.382566:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660838784 00000100:00100000:3.0:1788211761.382614:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660838656 00000100:00100000:3.0:1788211761.382617:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660838656 00000100:00100000:3.0:1788211761.382636:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788211761.382645:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660838784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211761.382696:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660838784:12345-0@lo:400:kworker.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211761.382702:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788211761.382718:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788211761.382724:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660838656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211761.382746:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660838656:12345-0@lo:400:kworker.0 Request processed in 22us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211761.382751:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788211761.382797:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660838656:0@lo:400:kworker.0 00000100:00100000:3.0:1788211761.382808:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660838784:0@lo:400:kworker.0 00000100:00100000:0.0:1788211761.383035:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660838912:0@lo:400:kworker.0 00000100:00100000:0.0:1788211761.383068:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211761.383096:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788211761.383102:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660838528:0@lo:400:kworker.0 00000100:00100000:0.0:1788211761.383129:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211761.383156:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660839040:0@lo:400:kworker.0 00000100:00100000:0.0:1788211761.383203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211761.383230:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660838528 00000100:00100000:0.0:1788211761.383234:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660838528 00000100:00100000:0.0:1788211761.383263:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788211761.383270:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660838528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211761.383306:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660838528:12345-0@lo:400:kworker.0 Request processed in 37us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211761.383312:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788211761.383348:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660838528:0@lo:400:kworker.0 00000100:00080000:1.0:1788211761.383587:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211761.383942:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660838912 00000100:00100000:2.0:1788211761.383949:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660838912 00000100:00100000:2.0:1788211761.384006:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788211761.384015:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660838912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211761.384082:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660838912:12345-0@lo:400:kworker.0 Request processed in 69us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211761.384090:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788211761.384121:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660839040 00000100:00100000:2.0:1788211761.384125:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660839040 00000100:00100000:2.0:1788211761.384151:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788211761.384158:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660839040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211761.384224:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660839040:12345-0@lo:400:kworker.0 Request processed in 66us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211761.384230:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788211761.384266:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660839040:0@lo:400:kworker.0 00000100:00100000:2.0:1788211761.384277:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660838912:0@lo:400:kworker.0 00000100:00080000:1.0:1788211761.384484:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211761.384488:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211761.898156:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660839168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211761.898248:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211761.898322:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660839168 00000100:00100000:2.0:1788211761.898330:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660839168 00000100:00100000:2.0:1788211761.898387:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788211761.898397:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660839168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211761.898431:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211761.898475:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660839168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211761.898482:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788211761.899711:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660839168:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788211762.215301:0:11859:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 17:29:20 (1788211760) 00010000:00010000:3.0:1788211762.347545:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211762.396294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211762.396327:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211762.396360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211762.396446:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637732864 00000100:00100000:2.0:1788211762.396457:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637732864 00000100:00100000:2.0:1788211762.396535:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637732992 00000100:00100000:2.0:1788211762.396538:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637732992 00000100:00100000:2.0:1788211762.396564:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 138 00000100:00100000:2.0:1788211762.396574:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637732864:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211762.396651:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637732864:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 78us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211762.396658:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 138 00000100:00100000:2.0:1788211762.396676:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 139 00000100:00100000:2.0:1788211762.396683:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637732992:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211762.396708:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637732992:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211762.396713:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 139 00000100:00100000:1.0:1788211762.396949:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637732736 00000100:00100000:1.0:1788211762.396955:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637732736 00000100:00100000:1.0:1788211762.396989:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 287 00000100:00100000:1.0:1788211762.396998:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637732736:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211762.397034:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637732736:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 38us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211762.397040:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 287 00000100:00080000:3.0:1788211762.397285:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788211763.366718:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211764.103682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211764.113090:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637733120 00000100:00100000:1.0:1788211764.113110:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637733120 00000100:00100000:1.0:1788211764.113232:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:1.0:1788211764.113247:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:10241:x1875075637733120:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788211764.113269:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211764.113296:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5819 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211764.113387:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a5799 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211764.113401:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a5799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211764.113414:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a5799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211764.113671:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788211764.113676:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788211764.113803:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a5799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211764.113833:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5819 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211764.113849:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a5799 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5819 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211764.113858:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ecf00) 00010000:00010000:1.0:1788211764.113861:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788211764.113864:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07200, rc 0) 00000100:00100000:1.0:1788211764.113945:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:10241:x1875075637733120:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 702us (10275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211764.113952:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00080000:3.0:1788211764.115823:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211764.122685:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211764.122760:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637733248 00000100:00100000:2.0:1788211764.122772:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637733248 00000100:00100000:2.0:1788211764.122843:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:2.0:1788211764.122855:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:10242:x1875075637733248:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211764.122881:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211764.122904:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a57a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5820 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.123005:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.123021:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.123050:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.123066:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.123072:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.123079:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.123601:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a57b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.123612:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a57b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.123620:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a57b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211764.124776:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788211764.124784:0:9952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211764.124884:0:9952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a57b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.124898:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.124904:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.124920:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125323:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211764.125328:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125336:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125352:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ecf00) 00010000:00010000:2.0:1788211764.125356:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211764.125361:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125367:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125384:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125390:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125396:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125400:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211764.125403:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125420:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125428:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8abfc9a0da00) 00010000:00010000:2.0:1788211764.125430:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211764.125432:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125437:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125480:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a57a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5820 expref: 8 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.125493:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a57b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5820 expref: 7 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.126124:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8abfc9a0de00) 00010000:00010000:2.0:1788211764.126129:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211764.126133:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80a00, rc 0) 00000100:00100000:2.0:1788211764.126320:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:10242:x1875075637733248:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 3464us (3642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211764.126331:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:0.0:1788211764.134150:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211764.134354:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637733504 00000100:00100000:2.0:1788211764.134364:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637733504 00000100:00100000:2.0:1788211764.134467:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:2.0:1788211764.134479:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:10242:x1875075637733504:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211764.134528:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211764.134550:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a57bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5827 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.134636:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57c3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.134663:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.134676:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.134692:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.134699:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.134706:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135348:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a57d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135360:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a57d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135369:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a57d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211764.135380:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788211764.135587:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135596:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57c3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135603:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135609:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211764.135613:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135620:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57c3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135633:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8abfc9a0de00) 00010000:00010000:2.0:1788211764.135636:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211764.135640:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135646:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a57c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135659:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135665:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57ca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135671:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135686:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211764.135689:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135695:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57ca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135703:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8abfc9a0da00) 00010000:00010000:2.0:1788211764.135705:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211764.135708:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57ca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.135714:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a57ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.136120:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a57bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5827 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.136138:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a57d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5827 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211764.136146:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfc9a0db00) 00010000:00010000:2.0:1788211764.136149:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211764.136151:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81600, rc 0) 00000100:00100000:2.0:1788211764.136289:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:10242:x1875075637733504:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1811us (2147us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788211764.136310:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:3.0:1788211764.141904:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211764.142409:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637733632 00000100:00100000:2.0:1788211764.142437:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637733632 00000100:00100000:2.0:1788211764.142551:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:2.0:1788211764.142564:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:10242:x1875075637733632:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788211764.142716:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:10242:x1875075637733632:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 Request processed in 155us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211764.142725:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00010000:00010000:2.0:1788211764.397352:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788211764.398076:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788211765.417512:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211766.001531:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788211766.011826:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660839296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211766.011911:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211766.020956:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660839296 00000100:00100000:2.0:1788211766.020972:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660839296 00000100:00100000:2.0:1788211766.021096:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788211766.021107:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660839296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788211766.021147:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211766.021254:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660839296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (9342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211766.021261:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1788211766.021322:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abffde64a80 x1875075660839296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211766.021344:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660839296:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788211766.029752:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788211766.441150:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211766.503571:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660839680:0@lo:400:kworker.0 00000100:00100000:1.0:1788211766.503659:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211766.503752:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788211766.503759:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660839808:0@lo:400:kworker.0 00000100:00100000:1.0:1788211766.503781:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211766.503839:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660839680 00000100:00100000:1.0:1788211766.503858:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660839680 00000100:00100000:1.0:1788211766.503913:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660839808 00000100:00100000:1.0:1788211766.503916:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660839808 00000100:00100000:1.0:1788211766.503939:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788211766.503948:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660839680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211766.504012:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660839680:12345-0@lo:400:kworker.0 Request processed in 64us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211766.504020:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788211766.504037:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788211766.504044:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660839808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211766.504070:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660839808:12345-0@lo:400:kworker.0 Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211766.504076:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1788211766.504094:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211766.504126:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660839808:0@lo:400:kworker.0 00000100:00100000:1.0:1788211766.504150:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660839680:0@lo:400:kworker.0 00000100:00100000:2.0:1788211766.504636:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660839424:0@lo:400:kworker.0 00000100:00100000:2.0:1788211766.504678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211766.504715:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660839936:0@lo:400:kworker.0 00000100:00100000:2.0:1788211766.504739:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211766.504757:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211766.504762:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660839552:0@lo:400:kworker.0 00000100:00100000:2.0:1788211766.504783:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211766.504829:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660839552 00000100:00100000:2.0:1788211766.504834:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660839552 00000100:00100000:2.0:1788211766.504877:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788211766.504885:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660839552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211766.504925:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660839552:12345-0@lo:400:kworker.0 Request processed in 40us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211766.504932:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788211766.504957:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660839552:0@lo:400:kworker.0 00000100:00100000:1.0:1788211766.505290:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660839424 00000100:00100000:1.0:1788211766.505295:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660839424 00000100:00100000:1.0:1788211766.505326:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788211766.505333:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660839424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211766.505374:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660839424:12345-0@lo:400:kworker.0 Request processed in 41us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211766.505380:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788211766.505406:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660839936 00000100:00100000:1.0:1788211766.505409:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660839936 00000100:00100000:1.0:1788211766.505440:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788211766.505447:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660839936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211766.505476:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660839936:12345-0@lo:400:kworker.0 Request processed in 29us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211766.505481:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788211766.505506:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788211766.505523:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660839424:0@lo:400:kworker.0 00000100:00100000:1.0:1788211766.505534:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660839936:0@lo:400:kworker.0 00000100:00100000:3.0:1788211766.721222:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211766.721327:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637733760 00000100:00100000:0.0:1788211766.721338:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637733760 00000100:00100000:0.0:1788211766.721410:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:0.0:1788211766.721421:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:10285:x1875075637733760:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788211766.721443:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211766.721464:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a57df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f582e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.721548:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a57e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.721563:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a57e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.721576:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a57e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.721589:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a57ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.721595:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a57ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.721601:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a57ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722011:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a57e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722020:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a57e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722026:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a57e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722032:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cdc00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211766.722036:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a57e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722044:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a57e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722055:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ecf00) 00010000:00010000:0.0:1788211766.722058:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211766.722062:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a57e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722069:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a57e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722079:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a57ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722085:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a57ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722090:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a57ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722103:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cca00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211766.722106:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a57ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722112:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a57ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722121:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8abfdb434800) 00010000:00010000:0.0:1788211766.722124:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211766.722127:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a57ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722133:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a57ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722190:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a57df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f582e expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722201:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ecf00) 00010000:00010000:0.0:1788211766.722204:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211766.722208:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a57df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f582e expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.722217:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd000, rc 0) 00000100:00100000:0.0:1788211766.722284:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:10285:x1875075637733760:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 864us (1071us total) trans 0 rc 301/301 00000100:00100000:0.0:1788211766.722292:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00080000:3.0:1788211766.722361:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211766.729452:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211766.729565:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637734016 00000100:00100000:0.0:1788211766.729600:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637734016 00000100:00100000:0.0:1788211766.729666:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:0.0:1788211766.729678:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:10285:x1875075637734016:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:0.0:1788211766.730876:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211766.730923:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a5799 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5819 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.730942:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ecf00) 00010000:00010000:0.0:1788211766.730955:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788211766.731303:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a57f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.731317:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a57f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.731326:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a57f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.731337:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a57fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.731344:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a57fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.731350:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a57fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211766.736543:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1788211766.736564:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a57f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.736575:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a57f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.736590:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a57f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.736597:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211766.736602:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a57f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.736609:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a57f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.736626:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434600) 00010000:00010000:0.0:1788211766.736630:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211766.736634:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a57f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211766.736641:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a57f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788211766.736662:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3f5e5e2 reply state 000000001a9c1b86 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a57fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211766.736672:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788211766.736807:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:10285:x1875075637734016:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 7128us (7365us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788211766.736817:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00010000:00010000:3.0:1788211766.751792:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a57fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211766.751818:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a57fb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211766.751827:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a57fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211766.751834:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211766.752011:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a57fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211766.752023:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a57fb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211766.752042:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8abfdb434400) 00010000:00010000:3.0:1788211766.752046:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211766.752057:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a57fb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211766.752072:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a57fb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211766.872376:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211766.872507:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637734144 00000100:00100000:1.0:1788211766.872519:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637734144 00000100:00100000:1.0:1788211766.872589:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:1.0:1788211766.872601:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:10293:x1875075637734144:12345-192.168.204.29@tcp:101:lctl.0 00010000:00010000:1.0:1788211766.872633:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211766.872660:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5835 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211766.872745:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a5809 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211766.872760:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a5809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211766.872772:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a5809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211766.872876:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788211766.872881:0:9952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788211766.872932:0:9952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a5809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211766.872960:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5835 expref: 11 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211766.872980:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a5809 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5835 expref: 10 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211766.873005:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec100) 00010000:00010000:1.0:1788211766.873009:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788211766.873013:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07200, rc 0) 00000100:00100000:1.0:1788211766.873082:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:10293:x1875075637734144:12345-192.168.204.29@tcp:101:lctl.0 Request processed in 483us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211766.873090:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:0.0:1788211767.000559:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211767.000681:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637734272 00000100:00100000:1.0:1788211767.000692:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637734272 00000100:00100000:1.0:1788211767.000755:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:1.0:1788211767.000766:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:10299:x1875075637734272:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788211767.000787:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211767.000823:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f583c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.000909:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5817 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.000923:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.000934:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.000949:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a581e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.000956:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a581e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.000983:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a581e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001100:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a5825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001108:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a5825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001116:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a5825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211767.001150:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1788211767.001154:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788211767.001257:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a5825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001270:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001276:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5817 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001282:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5817 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001287:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211767.001291:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5817 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001298:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5817 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001316:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec100) 00010000:00010000:1.0:1788211767.001319:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211767.001323:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5817 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001330:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5817 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001343:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a581e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001350:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a581e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001355:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a581e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001360:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211767.001363:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a581e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001370:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a581e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001378:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8abfc37ec800) 00010000:00010000:1.0:1788211767.001380:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211767.001382:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a581e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001387:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a581e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001430:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f583c expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001442:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a5825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f583c expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.001450:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:1.0:1788211767.001452:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788211767.001455:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06a00, rc 0) 00000100:00100000:1.0:1788211767.001513:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+11:10299:x1875075637734272:12345-192.168.204.29@tcp:101:bash.0 Request processed in 748us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211767.001520:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:3.0:1788211767.013430:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660840064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211767.013521:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211767.013608:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660840064 00000100:00100000:3.0:1788211767.013617:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660840064 00000100:00100000:3.0:1788211767.013684:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788211767.013694:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660840064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211767.013733:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211767.013801:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660840064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211767.013810:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788211767.013972:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660840064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788211767.028154:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211767.028681:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637734528 00000100:00100000:2.0:1788211767.028694:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637734528 00000100:00100000:2.0:1788211767.028752:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:2.0:1788211767.028763:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+11:10299:x1875075637734528:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1788211767.028791:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211767.028826:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a582c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5843 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.029192:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5833 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.029207:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5833 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.029218:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5833 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.029233:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a583a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.029241:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a583a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.029268:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a583a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788211767.030104:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788211767.030441:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.030454:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.030463:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.030504:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5833 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.030511:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5833 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.030519:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5833 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.030524:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211767.030529:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5833 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.030536:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5833 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.030548:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:2.0:1788211767.030551:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211767.030562:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5833 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.030569:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5833 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788211767.030582:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4ca913c reply state 00000000eec8f1f0 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a583a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211767.030591:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788211767.030628:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a582c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5843 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.030643:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5843 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.030650:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc9a0d100) 00010000:00010000:2.0:1788211767.030652:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211767.030654:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81200, rc 0) 00000100:00100000:2.0:1788211767.030743:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:10299:x1875075637734528:12345-192.168.204.29@tcp:101:bash.0 Request processed in 1982us (2599us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788211767.030753:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 40 00010000:00010000:2.0:1788211767.039424:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a583a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.039446:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a583a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.039455:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a583a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.039483:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211767.039489:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a583a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.039497:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a583a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.039515:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc9a0da00) 00010000:00010000:2.0:1788211767.039518:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211767.039523:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a583a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.039529:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a583a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211767.042978:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211767.043018:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637734656 00000100:00100000:3.0:1788211767.043028:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637734656 00000100:00100000:3.0:1788211767.043070:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:3.0:1788211767.043079:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875075637734656:12345-192.168.204.29@tcp:8:bash.0 00010000:00080000:3.0:1788211767.043121:0:8290:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:3.0:1788211767.043157:0:8290:0:(genops.c:1385:class_connect()) connect: client a688ef06-7eb0-4c47-9425-de9843f5c0e0, cookie 0x2afbce82f55a584f 00002000:00100000:3.0:1788211767.043198:0:8290:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a688ef06-7eb0-4c47-9425-de9843f5c0e0/ffff8abffe3d0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788211767.043211:0:8290:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788211767.044384:0:8290:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788211767.044434:0:8290:0:(import.c:65:import_set_state_nolock()) ffff8abffe3d5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788211767.044530:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2357:x1875075637734656:12345-192.168.204.29@tcp:8:bash.0 Request processed in 1449us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211767.044539:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:3.0:1788211767.050363:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211767.053071:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637734784 00000100:00100000:1.0:1788211767.053088:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637734784 00000100:00100000:1.0:1788211767.053190:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:1.0:1788211767.053202:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:0:x1875075637734784:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788211767.053219:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211767.053252:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000941c703f/0x2afbce82f55a5856 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f584a expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788211767.053282:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788211767.053301:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1788211767.053306:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211767.053316:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941c703f/0x2afbce82f55a5856 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f584a expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.053354:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000941c703f/0x2afbce82f55a5856 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f584a expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.053367:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06800, rc 0) 00000100:00100000:1.0:1788211767.053438:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:0:x1875075637734784:12345-192.168.204.29@tcp:101:bash.0 Request processed in 237us (3087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211767.053445:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00080000:3.0:1788211767.055047:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788211767.060523:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211767.060647:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637734912 00000100:00100000:3.0:1788211767.060657:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637734912 00000100:00100000:3.0:1788211767.060709:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:3.0:1788211767.060721:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:10299:x1875075637734912:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:3.0:1788211767.060743:0:8290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211767.060770:0:8290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5851 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.060824:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000941c703f/0x2afbce82f55a5856 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f584a expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.060836:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211767.061005:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211767.061014:0:8290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 8 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.061058:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000941c703f/0x2afbce82f55a5856 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f584a expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.061073:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000941c703f/0x2afbce82f55a5856 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f584a expref: 8 pid: 6696 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211767.061095:0:8290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdf30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8290:1875075660840192:192.168.204.29@tcp:104: 00000100:00100000:3.0:1788211767.061223:0:8290:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc2a0bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788211767.073027:0:8290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdf30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8290:1875075660840192:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211767.073065:0:8290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 8 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.073089:0:8290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063000, rc 0) 00000100:00100000:1.0:1788211767.073302:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:10299:x1875075637734912:12345-192.168.204.29@tcp:101:bash.0 Request processed in 12582us (12792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211767.073310:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:1.0:1788211767.076222:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211767.076306:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637735040 00000100:00100000:2.0:1788211767.076318:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637735040 00010000:00010000:2.0:1788211767.076372:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000941c703f/0x2afbce82f55a5856 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f584a expref: 8 pid: 6696 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211767.076419:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:2.0:1788211767.076429:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe031c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637735040:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211767.076445:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211767.076469:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000941c703f/0x2afbce82f55a5856 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f584a expref: 8 pid: 6696 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.076484:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000941c703f/0x2afbce82f55a5856 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f584a expref: 8 pid: 6696 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.076527:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000941c703f/0x2afbce82f55a5856 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f584a expref: 8 pid: 6696 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.076548:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211767.076553:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211767.076561:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 7 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.076573:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 7 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.076611:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 7 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211767.076628:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1875075660840320:192.168.204.29@tcp:105: 00000100:00100000:2.0:1788211767.076717:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcd7e8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788211767.085078:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000001:00080000:0.0:1788211767.085114:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:3.0:1788211767.086546:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637735296 00000100:00100000:3.0:1788211767.086561:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637735296 00000100:00100000:3.0:1788211767.086636:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:3.0:1788211767.086648:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+11:10299:x1875075637735296:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:3.0:1788211767.087129:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+12:10299:x1875075637735296:12345-192.168.204.29@tcp:35:bash.0 Request processed in 483us (2060us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788211767.087138:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:2.0:1788211767.090213:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1875075660840320:192.168.204.29@tcp:105: 00010000:00010000:2.0:1788211767.090251:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211767.090330:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe031c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637735040:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 13901us (14118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211767.090340:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:1.0:1788211767.174470:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211767.174564:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637735552 00000100:00100000:2.0:1788211767.174576:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637735552 00000100:00100000:2.0:1788211767.174643:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:2.0:1788211767.174673:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+12:10309:x1875075637735552:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211767.174703:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211767.174727:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5864 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5858 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211767.175002:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1788211767.175143:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5864 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5858 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.175160:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec100) 00010000:00010000:2.0:1788211767.175163:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788211767.175204:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5864 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5858 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.175224:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80200, rc 0) 00000100:00100000:2.0:1788211767.175312:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:10309:x1875075637735552:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 642us (854us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788211767.175320:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:0.0:1788211767.178760:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211767.179008:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637735808 00000100:00100000:3.0:1788211767.179019:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637735808 00000100:00100000:3.0:1788211767.179077:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:3.0:1788211767.179087:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:10309:x1875075637735808:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1788211767.179428:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:10309:x1875075637735808:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 341us (687us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788211767.179435:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:3.0:1788211767.314650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211767.314808:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637735936 00000100:00100000:2.0:1788211767.314820:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637735936 00000100:00100000:2.0:1788211767.314899:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:2.0:1788211767.314910:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:10315:x1875075637735936:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211767.314936:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211767.314957:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5872 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f585f expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.315034:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.315064:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.315075:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211767.315136:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788211767.315141:0:6717:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211767.315162:0:6717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.315214:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5872 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f585f expref: 16 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.315232:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f585f expref: 15 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.315253:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:2.0:1788211767.315256:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211767.315259:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81800, rc 0) 00000100:00100000:2.0:1788211767.315317:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:10315:x1875075637735936:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 409us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211767.315324:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:1.0:1788211767.317973:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211767.318110:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637736192 00000100:00100000:2.0:1788211767.318120:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637736192 00000100:00100000:2.0:1788211767.318201:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:2.0:1788211767.318211:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:10315:x1875075637736192:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211767.318231:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211767.318272:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5880 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5866 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.318390:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5887 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.318404:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.318416:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211767.318427:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788211767.318570:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5880 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5866 expref: 18 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.318590:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5866 expref: 17 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.318599:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc9a0d100) 00010000:00010000:2.0:1788211767.318601:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211767.318606:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80400, rc 0) 00000100:00100000:2.0:1788211767.319789:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:10315:x1875075637736192:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1571us (1820us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788211767.319800:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:3.0:1788211767.329258:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211767.329303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211767.329566:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637736576 00000100:00100000:2.0:1788211767.329576:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637736576 00000100:00100000:2.0:1788211767.329639:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:2.0:1788211767.329651:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:2360:x1875075637736576:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211767.329693:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211767.329718:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5887 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5866 expref: 17 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.329738:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc9a0d100) 00010000:00010000:2.0:1788211767.329742:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211767.329800:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:2360:x1875075637736576:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 151us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211767.329808:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:1.0:1788211767.330790:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637736448 00000100:00100000:1.0:1788211767.330799:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637736448 00000100:00100000:1.0:1788211767.330839:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:1.0:1788211767.330858:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:10315:x1875075637736448:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1788211767.330880:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211767.330905:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5895 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f586d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.331008:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a589c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.331022:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a589c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.331033:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a589c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211767.331046:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788211767.331204:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5895 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f586d expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.331221:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a589c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f586d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.331228:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc9a0d100) 00010000:00010000:1.0:1788211767.331231:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788211767.331233:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06400, rc 0) 00000100:00100000:1.0:1788211767.331303:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:10315:x1875075637736448:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 456us (2061us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788211767.331310:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:3.0:1788211767.340579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211767.340778:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637736704 00000100:00100000:1.0:1788211767.340789:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637736704 00000100:00100000:1.0:1788211767.340849:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:1.0:1788211767.340859:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637736704:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1788211767.340923:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.340946:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 7 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.340954:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211767.340959:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788211767.340963:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.341002:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 7 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.341017:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 7 pid: 8290 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211767.341031:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe031880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875075660840448:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211767.341133:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788211767.354248:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe031880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875075660840448:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211767.354282:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211767.357091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211767.357905:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637736832 00000100:00100000:2.0:1788211767.357921:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637736832 00002000:00100000:2.0:1788211767.357988:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8abffdf33100 x1875075637736832/t0(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:318/0 lens 504/0 e 0 to 0 dl 1788211778 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788211767.358001:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abffdf33100 with x1875075637736832 ext(0->12) 00010000:00010000:2.0:1788211767.358011:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 8 pid: 8290 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.358031:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 8 pid: 8290 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788211767.358039:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8abffdf33100 00000100:00100000:2.0:1788211767.358079:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:2.0:1788211767.358090:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2358:x1875075637736832:12345-192.168.204.29@tcp:4:lfs.0 00000001:00100000:3.0:1788211767.437645:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a688ef06-7eb0-4c47-9425-de9843f5c0e0 00010000:00010000:0.0:1788211767.465526:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211767.527611:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2358:x1875075637736832:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 169507us (170514us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788211767.527665:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00002000:00100000:3.0:1788211767.527680:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8abffdf33100 x1875075637736832/t4294967299(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:318/0 lens 504/448 e 0 to 0 dl 1788211778 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211767.527690:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abffdf33100 with x1875075637736832 ext(0->12) 00010000:00010000:3.0:1788211767.527700:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 9 pid: 8290 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.527718:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 9 pid: 8290 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788211767.527726:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8abffdf33100 00000001:00080000:3.0:1788211767.527760:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788211767.553951:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211767.554017:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211767.554277:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637737088 00000100:00100000:0.0:1788211767.554287:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637737088 00000100:00100000:0.0:1788211767.554372:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 143 00000100:00100000:0.0:1788211767.554383:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637737088:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211767.554465:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637737088:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 84us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211767.554473:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 143 00000100:00080000:3.0:1788211767.554550:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211767.555114:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637736960 00000100:00100000:2.0:1788211767.555120:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637736960 00000100:00100000:2.0:1788211767.555163:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 289 00000100:00100000:2.0:1788211767.555226:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637736960:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211767.555282:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637736960:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 58us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211767.555288:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 289 00000100:00100000:3.0:1788211767.557001:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211767.557154:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637737216 00000100:00100000:2.0:1788211767.557163:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637737216 00010000:00010000:2.0:1788211767.557245:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 7 pid: 8290 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211767.557280:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:2.0:1788211767.557290:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2361:x1875075637737216:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211767.557305:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788211767.557327:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788211767.557330:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788211766 00002000:00010000:2.0:1788211767.557333:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788211766 00002000:00010000:2.0:1788211767.557335:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788211766 00002000:00010000:2.0:1788211767.557336:0:5830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788211767.557342:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 7 pid: 8290 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.557356:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 7 pid: 8290 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.557380:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a585d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5851 expref: 7 pid: 8290 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.557429:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788211767.557433:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788211767.557439:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.557449:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211767.557485:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211767.557538:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637737216:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 248us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211767.557546:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 36 00010000:00010000:1.0:1788211767.557821:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.557856:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.557882:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.557891:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.557898:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.557905:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788211767.557910:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.557919:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.557932:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.557940:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000254fbd5f/0x2afbce82f55a58aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211767.558004:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637736704:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 217147us (217434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211767.558013:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:2.0:1788211767.568551:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211767.568958:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637737472 00000100:00100000:3.0:1788211767.568971:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637737472 00000100:00100000:3.0:1788211767.569043:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1788211767.569054:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:10315:x1875075637737472:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:3.0:1788211767.569143:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a589c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f586d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788211767.569507:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788211767.569578:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788211767.570334:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788211767.570412:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.570431:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5841 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5843 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.570441:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.570497:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5843 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.570515:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5841 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5843 expref: 22 pid: 5843 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211767.570533:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1875075660840576:192.168.204.29@tcp:104: 00000100:00100000:3.0:1788211767.570681:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc886a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788211767.580606:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1875075660840576:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211767.580642:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211767.586871:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211767.597289:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637737600 00000100:00100000:3.0:1788211767.597305:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637737600 00010000:00010000:3.0:1788211767.597356:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5841 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5843 expref: 23 pid: 5843 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211767.597408:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:3.0:1788211767.597419:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:2359:x1875075637737600:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211767.597435:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211767.597443:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5841 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5843 expref: 23 pid: 5843 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.597458:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5843 expref: 23 pid: 5843 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.597503:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5841 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5843 expref: 23 pid: 5843 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.597524:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc9a0d100) 00010000:00010000:3.0:1788211767.597529:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.597539:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.597547:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.597588:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211767.600875:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:2359:x1875075637737600:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 3445us (14006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211767.600891:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00010000:00010000:0.0:1788211767.601422:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.601435:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788211767.601596:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788211767.601823:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788211767.601961:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001328700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875075660840704:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788211767.602021:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211767.602052:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788211767.602331:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660840704 00000100:00100000:3.0:1788211767.602340:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660840704 00000100:00100000:3.0:1788211767.602399:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788211767.602409:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875075660840704:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788211767.602498:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875075660840704:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 91us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211767.602505:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788211767.606641:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001328700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875075660840704:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788211767.609372:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788211767.609485:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe031880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875075660840832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788211767.609578:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211767.609659:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe1133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211767.611864:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660840832 00000100:00100000:3.0:1788211767.611878:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660840832 00000100:00100000:3.0:1788211767.612030:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788211767.612044:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875075660840832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788211767.614492:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1875075660840832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 2441us (4902us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788211767.614508:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788211767.614635:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe031880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875075660840832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788211767.614717:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788211767.614772:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.614784:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.614793:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.614799:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211767.614804:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.614812:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.614829:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc9a0d100) 00010000:00010000:1.0:1788211767.614833:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788211767.614851:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.614859:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a58b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788211767.615081:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788211767.615389:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788211767.615405:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356921237360ns, next at 357921234910ns, rc = 0 00000001:00080000:1.0:1788211767.615412:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788211767.615453:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc9a0d100) 00010000:00010000:1.0:1788211767.615457:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788211767.615465:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a589c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f586d expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211767.616354:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+25:10315:x1875075637737472:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 47297us (47812us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788211767.616365:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000020:00080000:1.0:1788211767.616371:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788211767.636228:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211767.636339:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637737728 00000100:00100000:1.0:1788211767.636350:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637737728 00000100:00100000:1.0:1788211767.636406:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:1.0:1788211767.636417:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+25:10315:x1875075637737728:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1788211767.636445:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211767.636477:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a58b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5874 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.636550:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a58b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5874 expref: 26 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.636601:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a58b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5874 expref: 26 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.636625:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:1.0:1788211767.636628:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788211767.636633:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06400, rc 0) 00000100:00100000:1.0:1788211767.636862:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:10315:x1875075637737728:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 446us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211767.636870:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:0.0:1788211767.645809:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211767.645928:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637737984 00000100:00100000:1.0:1788211767.645940:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637737984 00000100:00100000:1.0:1788211767.646016:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:1.0:1788211767.646029:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc64fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:10315:x1875075637737984:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1788211767.646317:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc64fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+27:10315:x1875075637737984:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 290us (517us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788211767.646326:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1788211767.771571:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211767.771679:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637738240 00000100:00100000:3.0:1788211767.771691:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637738240 00000100:00100000:3.0:1788211767.771756:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:3.0:1788211767.771766:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+27:10325:x1875075637738240:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211767.771791:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211767.771811:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a58bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f587b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211767.772131:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1788211767.772302:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a58bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f587b expref: 29 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.772317:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec100) 00010000:00010000:3.0:1788211767.772320:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788211767.772327:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a58bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f587b expref: 29 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211767.772342:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063c00, rc 0) 00000100:00100000:3.0:1788211767.772952:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:10325:x1875075637738240:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1182us (1387us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788211767.772962:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:2.0:1788211767.776962:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211767.777211:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637738368 00000100:00100000:1.0:1788211767.777222:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637738368 00000100:00100000:1.0:1788211767.777298:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:1.0:1788211767.777311:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:10325:x1875075637738368:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1788211767.777433:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a58cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777452:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a58cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777496:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a58cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777519:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a58d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777527:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a58d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777534:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a58d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777670:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a58db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777679:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a58db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777686:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a58db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788211767.777731:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a58db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777744:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a58cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777752:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a58cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777758:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a58cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777776:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211767.777781:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a58cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777950:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a58cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777965:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:1.0:1788211767.777969:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211767.777973:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a58cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.777980:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a58cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778006:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a58d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778012:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a58d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778018:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a58d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778023:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211767.778025:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a58d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778030:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a58d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778047:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc37ec800) 00010000:00010000:1.0:1788211767.778050:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211767.778052:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a58d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778058:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a58d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778071:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a58db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778076:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a58db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778081:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a58db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778085:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211767.778087:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a58db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778092:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a58db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778100:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:1.0:1788211767.778102:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211767.778105:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a58db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211767.778111:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a58db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211767.778247:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:10325:x1875075637738368:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 937us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211767.778256:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:0.0:1788211767.782198:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211767.782287:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637738624 00000100:00100000:1.0:1788211767.782297:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637738624 00000100:00100000:1.0:1788211767.782350:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:1.0:1788211767.782361:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:10325:x1875075637738624:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1788211767.782795:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+29:10325:x1875075637738624:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 434us (634us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788211767.782804:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:2.0:1788211767.844653:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211767.845527:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637738880 00000100:00100000:0.0:1788211767.845543:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637738880 00000100:00100000:0.0:1788211767.845654:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:0.0:1788211767.845666:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+29:10328:x1875075637738880:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788211767.845696:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211767.845753:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a58e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5882 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.846123:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a58e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.846140:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a58e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.846154:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a58e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.846211:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a58f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.846219:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a58f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.846224:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a58f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.847761:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a58f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.847777:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a58f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.847787:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a58f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211767.847801:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788211767.849547:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a58e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849582:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a58e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849590:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a58e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849595:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211767.849600:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a58e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849608:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a58e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849635:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:0.0:1788211767.849638:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211767.849642:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a58e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849918:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a58e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849935:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a58f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849941:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a58f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849947:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a58f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849952:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211767.849961:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a58f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849967:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a58f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849975:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfdb434600) 00010000:00010000:0.0:1788211767.849977:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211767.849981:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a58f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.849986:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a58f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.850054:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a58e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5882 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.850070:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a58f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5882 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.850077:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:0.0:1788211767.850079:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788211767.850081:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc800, rc 0) 00000100:00100000:0.0:1788211767.851494:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:10328:x1875075637738880:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4503us (5537us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788211767.851508:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:2.0:1788211767.857485:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211767.857572:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637739008 00000100:00100000:0.0:1788211767.857583:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637739008 00000100:00100000:0.0:1788211767.857664:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:0.0:1788211767.857676:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:10328:x1875075637739008:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:0.0:1788211767.857766:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a5905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.857787:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a5905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.857812:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a5905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.857851:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a5905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.857859:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a5905 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.857866:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a5905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.857871:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8ccc00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211767.857876:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a5905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.857884:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a5905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.857896:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:0.0:1788211767.857899:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788211767.857902:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a5905 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211767.857908:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a5905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211767.857994:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:10328:x1875075637739008:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 321us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211767.858002:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:3.0:1788211767.864466:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211767.864707:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637739264 00000100:00100000:1.0:1788211767.864720:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637739264 00000100:00100000:1.0:1788211767.864784:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:1.0:1788211767.864794:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:10328:x1875075637739264:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1788211767.865679:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+32:10328:x1875075637739264:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 880us (1227us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788211767.865691:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1788211768.225758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211768.226057:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637739520 00000100:00100000:1.0:1788211768.226071:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637739520 00000100:00100000:1.0:1788211768.226161:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:1.0:1788211768.226210:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+32:10359:x1875075637739520:12345-192.168.204.29@tcp:101:cat.0 00000100:00080000:3.0:1788211768.226246:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788211768.226247:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211768.226270:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a590c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5889 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211768.226412:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5913 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211768.226427:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211768.226438:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211768.226457:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788211768.226652:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a590c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5889 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211768.226672:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5889 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211768.226681:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:1.0:1788211768.226684:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788211768.226687:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07c00, rc 0) 00000100:00100000:1.0:1788211768.226756:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:10359:x1875075637739520:12345-192.168.204.29@tcp:101:cat.0 Request processed in 549us (1006us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788211768.226764:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:2.0:1788211768.231353:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211768.231476:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637739776 00000100:00100000:0.0:1788211768.231486:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637739776 00000100:00100000:0.0:1788211768.231535:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:0.0:1788211768.231544:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:10359:x1875075637739776:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:0.0:1788211768.232121:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+35:10359:x1875075637739776:12345-192.168.204.29@tcp:35:cat.0 Request processed in 287us (487us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788211768.232130:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:3.0:1788211768.237274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211768.237868:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637739904 00000100:00100000:0.0:1788211768.237880:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637739904 00000100:00100000:0.0:1788211768.237967:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:0.0:1788211768.237979:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+35:2361:x1875075637739904:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211768.237998:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211768.238029:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5913 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5889 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.238050:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:0.0:1788211768.238055:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211768.238125:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:2361:x1875075637739904:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 147us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211768.238133:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:2.0:1788211768.326268:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211768.326358:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637740160 00000100:00100000:0.0:1788211768.326370:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637740160 00000100:00100000:0.0:1788211768.326462:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:0.0:1788211768.326474:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:10365:x1875075637740160:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1788211768.326509:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211768.326513:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788211768.327280:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f585f expref: 34 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.327312:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:0.0:1788211768.327318:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788211768.327339:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a5921 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5890 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.327703:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.327721:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a58f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5882 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.327730:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.327765:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a58f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5882 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.328110:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a58f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5882 expref: 34 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211768.328125:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001328000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660840960:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211768.329635:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc76c79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211768.333288:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211768.333424:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001328000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660840960:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211768.333456:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211768.333591:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637740288 00000100:00100000:3.0:1788211768.333600:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637740288 00010000:00010000:3.0:1788211768.333647:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a58f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5882 expref: 35 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211768.333686:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:3.0:1788211768.333694:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+35:2358:x1875075637740288:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211768.333707:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211768.333714:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a58f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5882 expref: 35 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.333724:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a58f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5882 expref: 35 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.333744:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a58f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5882 expref: 35 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.333757:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:3.0:1788211768.333761:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.333770:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.333776:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.333803:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211768.333866:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:2358:x1875075637740288:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 172us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211768.333885:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00010000:00010000:1.0:1788211768.333912:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211768.333921:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211768.333942:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788211768.334193:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a5921 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5890 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211768.334211:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5890 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211768.334232:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:1.0:1788211768.334235:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788211768.334238:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd800, rc 0) 00000100:00100000:1.0:1788211768.334267:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:10365:x1875075637740160:12345-192.168.204.29@tcp:101:dd.0 Request processed in 7796us (8011us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788211768.334275:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:3.0:1788211768.338747:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211768.338872:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637740544 00000100:00100000:2.0:1788211768.338882:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637740544 00000100:00100000:2.0:1788211768.339057:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:2.0:1788211768.339066:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:10365:x1875075637740544:12345-192.168.204.29@tcp:36:dd.0 00010000:00010000:2.0:1788211768.339499:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5936 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.339518:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.339529:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788211768.339574:0:9952:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788211768.339596:0:9952:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8e262ce reply state 00000000b37d94b9 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211768.339605:0:9952:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788211768.339703:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+37:10365:x1875075637740544:12345-192.168.204.29@tcp:36:dd.0 Request processed in 637us (963us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788211768.339711:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 52 00000020:00080000:2.0:1788211768.339716:0:9952:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788211768.341551:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.341567:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5936 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.341576:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5936 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.341582:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211768.341587:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5936 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.341594:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5936 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.341611:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:3.0:1788211768.341614:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211768.341618:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5936 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.341624:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5936 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.485586:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211768.734047:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211768.736780:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637740672 00000100:00100000:2.0:1788211768.736796:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637740672 00000100:00100000:3.0:1788211768.737331:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:3.0:1788211768.737346:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+36:10379:x1875075637740672:12345-192.168.204.29@tcp:101:stat.0 00010000:00010000:3.0:1788211768.737387:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211768.737432:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a593d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5897 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.737512:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5944 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.737540:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.737557:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.737577:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a594b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.737585:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a594b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.737591:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a594b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.737716:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.737727:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5890 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.737735:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5952 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.737775:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5890 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211768.737803:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5890 expref: 37 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211768.737816:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660841088:192.168.204.29@tcp:104: 00000100:00100000:3.0:1788211768.737947:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc886a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211768.742920:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660841088:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211768.742953:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211768.746635:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211768.746858:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637740928 00000100:00100000:0.0:1788211768.746869:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637740928 00000100:00100000:0.0:1788211768.746991:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:0.0:1788211768.747003:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+38:5600:x1875075637740928:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788211768.747413:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:5600:x1875075637740928:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 411us (787us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788211768.747421:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:2.0:1788211768.754408:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211768.754580:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637741056 00000100:00100000:0.0:1788211768.754590:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637741056 00010000:00010000:0.0:1788211768.754960:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5890 expref: 39 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211768.755054:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:0.0:1788211768.755065:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:2358:x1875075637741056:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211768.755079:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211768.755087:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5890 expref: 39 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.755102:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5890 expref: 39 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.755142:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5928 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5890 expref: 39 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.755158:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:0.0:1788211768.755163:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.755232:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.755240:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5952 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211768.755274:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211768.755333:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+38:2358:x1875075637741056:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 270us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211768.755341:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00010000:00010000:2.0:1788211768.756539:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756566:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211768.756617:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788211768.756621:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211768.756671:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756686:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756695:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756702:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5944 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756709:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756715:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211768.756718:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756725:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5944 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756737:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:2.0:1788211768.756740:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211768.756743:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5944 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756758:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5944 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756774:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a594b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756780:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a594b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756786:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a594b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756797:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211768.756801:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a594b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756807:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a594b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756814:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc5bbe000) 00010000:00010000:2.0:1788211768.756817:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211768.756820:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a594b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756825:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a594b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756864:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a593d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5897 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756878:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5897 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.756893:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:2.0:1788211768.756896:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211768.756898:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063000, rc 0) 00000100:00100000:2.0:1788211768.756961:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+37:10379:x1875075637740672:12345-192.168.204.29@tcp:101:stat.0 Request processed in 19618us (22925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211768.756970:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:3.0:1788211768.839086:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211768.839423:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637741312 00000100:00100000:1.0:1788211768.839437:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637741312 00000100:00100000:1.0:1788211768.839526:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:1.0:1788211768.839538:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+37:10385:x1875075637741312:12345-192.168.204.29@tcp:36:truncate.0 00010000:00010000:1.0:1788211768.839608:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211768.839651:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5897 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211768.839675:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:1.0:1788211768.839679:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788211768.839926:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5959 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211768.839939:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211768.839949:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788211768.840014:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788211768.840040:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cd1f46c reply state 00000000710e623c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211768.840048:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788211768.840250:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:10385:x1875075637741312:12345-192.168.204.29@tcp:36:truncate.0 Request processed in 713us (1178us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788211768.840259:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 54 00000020:00080000:1.0:1788211768.840266:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788211768.843130:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.843150:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5959 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.843158:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5959 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.843194:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211768.843200:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5959 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.843218:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5959 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.843237:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:2.0:1788211768.843241:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211768.843246:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5959 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211768.843252:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5959 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211769.071467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211769.071878:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637741440 00000100:00100000:2.0:1788211769.071889:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637741440 00000100:00100000:2.0:1788211769.071951:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:2.0:1788211769.071961:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+38:10399:x1875075637741440:12345-192.168.204.29@tcp:101:stat.0 00010000:00010000:2.0:1788211769.071997:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211769.072018:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5960 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f589e expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072087:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5967 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072103:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5967 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072115:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5967 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072128:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a596e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072134:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a596e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072140:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a596e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072279:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072288:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072306:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211769.072346:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788211769.072350:0:9952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211769.072384:0:9952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072397:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072404:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5967 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072411:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5967 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072417:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5967 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072424:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211769.072428:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5967 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072435:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5967 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072447:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:2.0:1788211769.072450:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211769.072455:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5967 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072471:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5967 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072486:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a596e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072492:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a596e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072498:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a596e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072503:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211769.072506:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a596e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072511:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a596e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072518:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc9a0d400) 00010000:00010000:2.0:1788211769.072521:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211769.072523:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a596e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072528:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a596e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072561:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5960 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f589e expref: 40 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072574:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f589e expref: 39 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.072588:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:2.0:1788211769.072590:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211769.072593:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80400, rc 0) 00000100:00100000:2.0:1788211769.072677:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:10399:x1875075637741440:12345-192.168.204.29@tcp:101:stat.0 Request processed in 716us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211769.072684:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:1.0:1788211769.179398:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211769.179509:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637741696 00000100:00100000:2.0:1788211769.179523:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637741696 00000100:00100000:2.0:1788211769.179592:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:2.0:1788211769.179603:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:10409:x1875075637741696:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211769.179634:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211769.179656:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a597c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58a5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211769.179815:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1788211769.180146:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a597c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58a5 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.180163:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec100) 00010000:00010000:2.0:1788211769.180221:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788211769.180228:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a597c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58a5 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.180243:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81200, rc 0) 00000100:00100000:2.0:1788211769.180410:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+40:10409:x1875075637741696:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 807us (1023us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788211769.180428:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:3.0:1788211769.184643:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211769.184814:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637741952 00000100:00100000:0.0:1788211769.184825:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637741952 00000100:00100000:0.0:1788211769.185068:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:0.0:1788211769.185080:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+40:10409:x1875075637741952:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1788211769.185390:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+41:10409:x1875075637741952:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 311us (757us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788211769.185398:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:1.0:1788211769.249228:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211769.249323:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637742208 00000100:00100000:0.0:1788211769.249335:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637742208 00000100:00100000:0.0:1788211769.249411:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:0.0:1788211769.249437:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+41:10415:x1875075637742208:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1788211769.249470:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211769.249494:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a598a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58ac expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.249629:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.249645:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f589e expref: 42 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.249654:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.249692:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f589e expref: 42 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.249704:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f589e expref: 42 pid: 9952 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211769.249718:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001328000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875075660841216:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211769.249821:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc5521300 going to sleep for 11 seconds 00000100:00100000:0.0:1788211769.252904:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001328000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875075660841216:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211769.252935:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211769.254445:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211769.254818:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637742336 00000100:00100000:0.0:1788211769.254844:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637742336 00010000:00010000:0.0:1788211769.254914:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f589e expref: 43 pid: 9952 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211769.254960:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:0.0:1788211769.254971:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe033480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+43:2358:x1875075637742336:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211769.254988:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211769.254996:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f589e expref: 43 pid: 9952 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.255009:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f589e expref: 43 pid: 9952 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.255035:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f589e expref: 43 pid: 9952 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.255055:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:0.0:1788211769.255060:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.255070:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.255079:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.255113:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211769.255352:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe033480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:2358:x1875075637742336:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 381us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211769.255361:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 40 00010000:00010000:1.0:1788211769.255597:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.255606:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211769.255638:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788211769.255815:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a598a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58ac expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.255849:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58ac expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.255857:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:1.0:1788211769.255861:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788211769.255864:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd400, rc 0) 00000100:00100000:1.0:1788211769.255905:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:10415:x1875075637742208:12345-192.168.204.29@tcp:101:bash.0 Request processed in 6472us (6748us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788211769.255913:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:1.0:1788211769.259650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211769.259719:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637742592 00000100:00100000:0.0:1788211769.259732:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637742592 00000100:00100000:0.0:1788211769.259793:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 58 00000100:00100000:0.0:1788211769.259804:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:10415:x1875075637742592:12345-192.168.204.29@tcp:36:bash.0 00010000:00010000:0.0:1788211769.260104:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a599f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.260120:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a599f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.260132:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a599f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788211769.260236:0:6717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788211769.260260:0:6717:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2567bdb reply state 00000000144cabc3 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a599f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211769.260269:0:6717:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788211769.260357:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+45:10415:x1875075637742592:12345-192.168.204.29@tcp:36:bash.0 Request processed in 554us (716us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788211769.260364:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 58 00000020:00080000:0.0:1788211769.260369:0:6717:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788211769.263010:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a599f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.263027:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a599f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.263035:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a599f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.263041:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211769.263045:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a599f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.263053:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a599f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.263093:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:3.0:1788211769.263096:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211769.263101:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a599f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.263107:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a599f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211769.269270:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211769.269410:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637742720 00000100:00100000:2.0:1788211769.269420:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637742720 00000100:00100000:2.0:1788211769.269486:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:2.0:1788211769.269497:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+44:10415:x1875075637742720:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1788211769.269523:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211769.269546:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a59a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58b3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.269640:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a59ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.269655:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58ac expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.269663:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a59ad lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.269699:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58ac expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211769.269713:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58ac expref: 45 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211769.269726:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660841344:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211769.269811:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcd7e8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788211769.273244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211769.273523:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660841344:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211769.273565:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a59ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211769.274089:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637742848 00000100:00100000:0.0:1788211769.274098:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637742848 00010000:00010000:0.0:1788211769.274138:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58ac expref: 46 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211769.274252:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:0.0:1788211769.274261:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+46:2359:x1875075637742848:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211769.274374:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211769.274390:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58ac expref: 46 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.274403:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58ac expref: 46 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.274426:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5991 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58ac expref: 46 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.274441:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:0.0:1788211769.274446:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a59ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.274456:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a59ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.274463:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a59ad lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.274490:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788211769.274596:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a59ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.274603:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a59ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211769.274658:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788211769.274663:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211769.274681:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a59ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.274712:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a59a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58b3 expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.274728:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a59ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58b3 expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.274736:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:3.0:1788211769.274744:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211769.274747:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81800, rc 0) 00000100:00100000:0.0:1788211769.274787:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+45:2359:x1875075637742848:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 526us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211769.274795:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:3.0:1788211769.275076:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+44:10415:x1875075637742720:12345-192.168.204.29@tcp:101:bash.0 Request processed in 5580us (5814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211769.275083:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:2.0:1788211769.280033:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211769.280120:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637743104 00000100:00100000:3.0:1788211769.280131:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637743104 00000100:00100000:3.0:1788211769.280289:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:3.0:1788211769.280301:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc64fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+44:10415:x1875075637743104:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:3.0:1788211769.280785:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc64fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+45:10415:x1875075637743104:12345-192.168.204.29@tcp:35:bash.0 Request processed in 484us (757us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788211769.280793:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:1.0:1788211769.376837:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211769.379308:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637743360 00000100:00100000:0.0:1788211769.379325:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637743360 00000100:00100000:0.0:1788211769.379405:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:0.0:1788211769.379416:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+45:10425:x1875075637743360:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788211769.379444:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211769.379470:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58ba expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211769.379637:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1788211769.379774:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58ba expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.379791:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec100) 00010000:00010000:0.0:1788211769.379795:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788211769.379801:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58ba expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.379819:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd400, rc 0) 00000100:00100000:0.0:1788211769.379898:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+46:10425:x1875075637743360:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 484us (3085us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788211769.379906:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:2.0:1788211769.390051:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211769.390332:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637743488 00000100:00100000:1.0:1788211769.390344:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637743488 00000100:00100000:1.0:1788211769.390428:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:1.0:1788211769.390441:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+46:10425:x1875075637743488:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1788211769.390529:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a59c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.390546:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a59c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.390558:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a59c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.390574:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a59c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.390580:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a59c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.390587:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a59c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.390701:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a59d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.390728:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a59d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.390737:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a59d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788211769.390799:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a59d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.390815:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a59c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391240:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a59c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391250:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a59c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391259:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211769.391265:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a59c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391276:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a59c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391292:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:1.0:1788211769.391295:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211769.391300:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a59c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391307:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a59c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391333:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a59c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391339:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a59c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391346:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a59c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391351:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211769.391355:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a59c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391788:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a59c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391801:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc37ec800) 00010000:00010000:1.0:1788211769.391804:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211769.391808:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a59c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391815:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a59c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391848:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a59d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391855:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a59d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391861:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a59d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391875:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211769.391879:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a59d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391885:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a59d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391894:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:1.0:1788211769.391896:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211769.391899:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a59d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.391904:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a59d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211769.392007:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+46:10425:x1875075637743488:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1565us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211769.392018:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:2.0:1788211769.404210:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211769.404314:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637743744 00000100:00100000:0.0:1788211769.404325:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637743744 00000100:00100000:0.0:1788211769.404388:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:0.0:1788211769.404399:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+46:10425:x1875075637743744:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1788211769.404751:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+47:10425:x1875075637743744:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 353us (588us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788211769.404759:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:2.0:1788211769.473302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211769.473385:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637744000 00000100:00100000:3.0:1788211769.473395:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637744000 00000100:00100000:3.0:1788211769.473460:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00100000:3.0:1788211769.473470:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+47:10428:x1875075637744000:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211769.473501:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211769.473522:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a59d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58c1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.473608:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a59de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.473631:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a59de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.473642:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a59de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.473673:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a59e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.473680:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a59e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.473685:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a59e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.473836:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a59ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.473844:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a59ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.473850:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a59ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211769.473860:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788211769.473968:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a59de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.473975:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a59de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.473981:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a59de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.473987:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211769.473990:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a59de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474005:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a59de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474018:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:3.0:1788211769.474021:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211769.474025:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a59de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474030:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a59de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474044:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a59e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474049:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a59e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474054:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a59e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474057:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211769.474060:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a59e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474064:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a59e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474069:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc5bbed00) 00010000:00010000:3.0:1788211769.474072:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211769.474074:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a59e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474086:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a59e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474125:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a59d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58c1 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474138:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a59ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58c1 expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.474144:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:3.0:1788211769.474146:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211769.474149:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063400, rc 0) 00000100:00100000:3.0:1788211769.474291:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+49:10428:x1875075637744000:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 821us (998us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788211769.474299:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00100000:2.0:1788211769.482408:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211769.482565:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637744128 00000100:00100000:0.0:1788211769.482577:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637744128 00000100:00100000:0.0:1788211769.482645:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:0.0:1788211769.482655:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+49:10428:x1875075637744128:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:0.0:1788211769.482730:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.482761:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.482773:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.482803:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.482811:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.482818:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.482983:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211769.482988:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.482996:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.483009:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:0.0:1788211769.483012:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788211769.483017:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.483024:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a59fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211769.483107:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+49:10428:x1875075637744128:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 453us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211769.483121:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:1.0:1788211769.485107:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211769.485193:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637744384 00000100:00100000:3.0:1788211769.485214:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637744384 00000100:00100000:3.0:1788211769.485261:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:3.0:1788211769.485270:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+49:10428:x1875075637744384:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1788211769.485938:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+50:10428:x1875075637744384:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 665us (837us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788211769.485947:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:2.0:1788211769.490564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211769.492802:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637744512 00000100:00100000:3.0:1788211769.492815:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637744512 00000100:00100000:3.0:1788211769.492896:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:3.0:1788211769.492907:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+50:2358:x1875075637744512:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211769.492936:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211769.492960:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a59ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58c1 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211769.492979:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:3.0:1788211769.492983:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211769.493053:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+49:2358:x1875075637744512:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 147us (2499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211769.493060:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00010000:00010000:1.0:1788211769.511939:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211769.718262:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211769.718404:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637744768 00000100:00100000:1.0:1788211769.718415:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637744768 00000100:00100000:1.0:1788211769.718479:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:1.0:1788211769.718490:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+49:10446:x1875075637744768:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1788211769.718514:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211769.718534:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58c8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.718679:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.718693:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.718705:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211769.718716:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788211769.719015:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58c8 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.719033:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58c8 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.719041:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:1.0:1788211769.719044:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788211769.719047:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07c00, rc 0) 00000100:00100000:1.0:1788211769.719099:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:10446:x1875075637744768:12345-192.168.204.29@tcp:101:cat.0 Request processed in 610us (844us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788211769.719106:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:1.0:1788211769.777329:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211769.777584:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637744896 00000100:00100000:0.0:1788211769.777597:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637744896 00000100:00100000:0.0:1788211769.777728:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:0.0:1788211769.777741:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:10447:x1875075637744896:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788211769.777781:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211769.777804:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5a16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58cf expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.777894:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5a1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.777911:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.777923:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211769.777994:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1788211769.777998:0:6717:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788211769.778821:0:6717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.778879:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5a16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58cf expref: 53 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.778903:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58cf expref: 52 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.778938:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:0.0:1788211769.778942:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788211769.778946:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cda00, rc 0) 00000100:00100000:0.0:1788211769.779248:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10447:x1875075637744896:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1506us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211769.779258:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:0.0:1788211769.789848:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211769.790584:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637745280 00000100:00100000:1.0:1788211769.790597:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637745280 00000100:00100000:1.0:1788211769.790768:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:1.0:1788211769.790779:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10447:x1875075637745280:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1788211769.791856:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+53:10447:x1875075637745280:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 1073us (2023us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788211769.791867:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:2.0:1788211769.794738:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211769.794933:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637745408 00000100:00100000:0.0:1788211769.794945:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637745408 00000100:00100000:0.0:1788211769.795125:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:0.0:1788211769.795137:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+53:10447:x1875075637745408:12345-192.168.204.29@tcp:103:lfs.0 00010000:00010000:0.0:1788211769.795155:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788211769.795217:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a59ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58b3 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.795244:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58c8 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.795259:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a58b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5874 expref: 51 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211769.795271:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:0.0:1788211769.795284:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211769.795365:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+50:10447:x1875075637745408:12345-192.168.204.29@tcp:103:lfs.0 Request processed in 229us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211769.795392:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:2.0:1788211769.799900:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211769.800205:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637745536 00000100:00100000:1.0:1788211769.800219:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637745536 00000100:00100000:1.0:1788211769.800289:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00100000:1.0:1788211769.800302:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+50:10447:x1875075637745536:12345-192.168.204.29@tcp:58:lfs.0 00010000:00010000:1.0:1788211769.800470:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a5a24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.800490:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a5a24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.800503:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a5a24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788211769.800858:0:9952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788211769.802232:0:9952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788211769.802328:0:9952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788211769.802948:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+50:10447:x1875075637745536:12345-192.168.204.29@tcp:58:lfs.0 Request processed in 2640us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211769.802960:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00100000:0.0:1788211769.843375:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211769.843439:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637745664 00000100:00100000:1.0:1788211769.843452:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637745664 00000100:00100000:1.0:1788211769.843524:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 67 00000100:00100000:1.0:1788211769.843536:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+50:10449:x1875075637745664:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1788211769.843561:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211769.843584:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5a2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58d6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843673:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5a32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843690:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5a32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843716:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5a32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843734:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843741:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843747:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843851:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843859:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843866:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211769.843922:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788211769.843926:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788211769.843952:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843964:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843973:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5a32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843990:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5a32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.843998:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5a32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844005:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211769.844010:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5a32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844017:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5a32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844029:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:1.0:1788211769.844032:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211769.844038:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5a32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844045:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5a32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844061:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844067:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844074:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844078:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211769.844089:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844095:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844103:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc37ec700) 00010000:00010000:1.0:1788211769.844105:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211769.844108:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844113:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5a39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844146:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5a2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58d6 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844159:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58d6 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211769.844246:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec800) 00010000:00010000:1.0:1788211769.844249:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788211769.844252:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06800, rc 0) 00000100:00100000:1.0:1788211769.844317:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:10449:x1875075637745664:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 782us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211769.844324:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 67 00000040:00080000:1.0:1788211770.533985:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788211770.533997:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788211770.534051:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788211770.534059:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788211770.534313:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe031500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1875075660841472:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788211770.534444:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113c00 going to sleep for 11 seconds 00010000:00010000:2.0:1788211770.534891:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211770.542514:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211770.542589:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637745792 00000100:00100000:3.0:1788211770.542598:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637745792 00000100:00100000:3.0:1788211770.542726:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:3.0:1788211770.542739:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10460:x1875075637745792:12345-192.168.204.29@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788211770.542816:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10460:x1875075637745792:12345-192.168.204.29@tcp:900:lhsmtool_posix.0 Request processed in 80us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211770.542824:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00080000:1.0:1788211770.542886:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211770.542954:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe031500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1875075660841472:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788211770.545899:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211770.545997:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637745920 00000100:00100000:0.0:1788211770.546008:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637745920 00000100:00100000:0.0:1788211770.546066:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:0.0:1788211770.546077:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:10460:x1875075637745920:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788211770.546110:0:6717:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788211770.546292:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:10460:x1875075637745920:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 216us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211770.546301:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:2.0:1788211770.563282:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211770.563336:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637746048 00000100:00100000:0.0:1788211770.563351:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637746048 00000100:00100000:0.0:1788211770.563423:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:0.0:1788211770.563434:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:10460:x1875075637746048:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788211770.563512:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5a47 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563530:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5a47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563542:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5a47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563561:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5a4e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563586:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5a4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563604:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5a4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563634:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5a55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563643:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563650:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211770.563695:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788211770.563700:0:9952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788211770.563716:0:9952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563729:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5a47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563736:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5a47 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563742:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5a47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563749:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cce00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211770.563753:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5a47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563767:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5a47 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563781:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfc9a0db00) 00010000:00010000:0.0:1788211770.563783:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211770.563788:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5a47 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563794:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5a47 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563805:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5a4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563810:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5a4e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563815:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5a4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563820:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cde00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211770.563823:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5a4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563840:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5a4e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563848:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8abfdb434600) 00010000:00010000:0.0:1788211770.563850:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211770.563852:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5a4e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563868:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5a4e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563884:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563890:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5a55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563895:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5a55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563900:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211770.563903:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5a55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563908:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5a55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563916:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec800) 00010000:00010000:0.0:1788211770.563918:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211770.563921:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5a55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.563927:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5a55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211770.564014:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:10460:x1875075637746048:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 Request processed in 580us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211770.564023:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:2.0:1788211770.567522:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211770.567744:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637746304 00000100:00100000:0.0:1788211770.567754:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637746304 00000100:00100000:0.0:1788211770.567822:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:0.0:1788211770.567835:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:10460:x1875075637746304:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788211770.567863:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211770.567887:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5a5c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58dd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.567996:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.568011:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.568022:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211770.568033:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788211770.568121:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.568128:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5a63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.568135:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.568141:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211770.568145:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.568152:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.568213:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec800) 00010000:00010000:0.0:1788211770.568217:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788211770.568222:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5a63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.568229:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.568266:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5a5c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58dd expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.568276:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfc9a0db00) 00010000:00010000:0.0:1788211770.568278:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788211770.568282:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5a5c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58dd expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.568290:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc000, rc 0) 00000100:00100000:0.0:1788211770.568343:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10460:x1875075637746304:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 512us (833us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788211770.568351:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:0.0:1788211770.573333:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211770.574811:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637746432 00000100:00100000:3.0:1788211770.574830:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637746432 00000100:00100000:3.0:1788211770.574921:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00100000:3.0:1788211770.574934:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10460:x1875075637746432:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788211770.574978:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788211770.575132:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10460:x1875075637746432:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 201us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211770.575140:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00100000:2.0:1788211770.579344:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211770.579505:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637746688 00000100:00100000:3.0:1788211770.579518:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637746688 00000100:00100000:3.0:1788211770.579584:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 72 00000100:00100000:3.0:1788211770.579604:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10460:x1875075637746688:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788211770.579627:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211770.579631:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788211770.579665:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5a1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58cf expref: 52 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.579687:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:3.0:1788211770.579693:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788211770.579708:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5a71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58e4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788211770.580281:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788211770.580543:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5a78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.580562:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.580575:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.580649:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5a71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58e4 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.580667:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5a78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58e4 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.580697:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc5bbe400) 00010000:00010000:3.0:1788211770.580701:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211770.580704:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063a00, rc 0) 00000100:00100000:3.0:1788211770.580806:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+53:10460:x1875075637746688:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1212us (1476us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788211770.580816:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 72 00000100:00100000:1.0:1788211770.586692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211770.586863:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637746944 00000100:00100000:3.0:1788211770.586879:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637746944 00000100:00100000:3.0:1788211770.586965:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:3.0:1788211770.586979:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+53:10460:x1875075637746944:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788211770.587060:0:6717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211770.587100:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5a78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58e4 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587120:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc5bbe400) 00010000:00010000:3.0:1788211770.587133:0:6717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788211770.587203:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5a86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587220:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5a86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587230:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5a86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587249:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5a8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xaed3aa85 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587279:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaed3aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587286:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaed3aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587402:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5a86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587411:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5a86 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587417:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5a86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587424:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211770.587430:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5a86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587439:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5a86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587448:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:3.0:1788211770.587452:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211770.587455:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5a86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587461:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5a86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587471:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaed3aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587484:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5a8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaed3aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587489:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5a8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaed3aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587494:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211770.587497:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5a8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaed3aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587503:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5a8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaed3aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587512:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xaed3aa85 (ffff8abfc5bbee00) 00010000:00010000:3.0:1788211770.587514:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211770.587517:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5a8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaed3aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.587523:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5a8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaed3aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211770.587625:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10460:x1875075637746944:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 649us (952us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788211770.587634:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:2.0:1788211770.592295:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211770.592411:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637747072 00000100:00100000:3.0:1788211770.592426:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637747072 00000100:00100000:3.0:1788211770.592506:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 74 00000100:00100000:3.0:1788211770.592521:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10460:x1875075637747072:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788211770.592553:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211770.592612:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5a94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58eb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.592659:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5a9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.592675:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.592688:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.592806:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5a94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58eb expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.592829:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58eb expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.592840:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:3.0:1788211770.592843:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788211770.592847:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062c00, rc 0) 00000100:00100000:3.0:1788211770.592939:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+53:10460:x1875075637747072:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 422us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211770.592947:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 74 00000100:00100000:1.0:1788211770.597953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211770.598085:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637747328 00000100:00100000:3.0:1788211770.598099:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637747328 00000100:00100000:3.0:1788211770.598208:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 75 00000100:00100000:3.0:1788211770.598223:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+53:10460:x1875075637747328:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788211770.598338:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5aa2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.598492:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.598505:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788211770.598863:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788211770.598876:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359904708505ns, next at 360904705448ns, rc = 0 00000004:00010000:3.0:1788211770.598979:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085b8bfce reply state 00000000b342bfea transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211770.598990:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788211770.599149:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:10460:x1875075637747328:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 929us (1209us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788211770.599157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 75 00000100:00100000:0.0:1788211770.614237:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211770.614294:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637747456 00000100:00100000:0.0:1788211770.614306:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637747456 00000100:00100000:0.0:1788211770.617612:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:0.0:1788211770.617638:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:10460:x1875075637747456:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788211770.617663:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211770.617700:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5aa9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58f2 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.617784:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58f2 expref: 56 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.617800:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58f2 expref: 56 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.617825:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:0.0:1788211770.617829:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788211770.617833:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd800, rc 0) 00000100:00100000:0.0:1788211770.617903:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10460:x1875075637747456:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 278us (3685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211770.617910:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 76 00010000:00010000:3.0:1788211770.625803:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.625820:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5aa2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.625829:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.625835:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211770.625840:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.625847:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5aa2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.625883:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:3.0:1788211770.625887:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788211770.625892:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5aa2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.625898:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5aa2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211770.626129:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211770.626991:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637747584 00000100:00100000:3.0:1788211770.627003:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637747584 00000100:00100000:3.0:1788211770.627051:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:3.0:1788211770.627059:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875075637747584:12345-192.168.204.29@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788211770.627092:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:3.0:1788211770.627128:0:6695:0:(genops.c:1385:class_connect()) connect: client a688ef06-7eb0-4c47-9425-de9843f5c0e0, cookie 0x2afbce82f55a5ab0 00002000:00100000:3.0:1788211770.627141:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a688ef06-7eb0-4c47-9425-de9843f5c0e0/ffff8abffe3d5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788211770.627205:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788211770.627469:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788211770.627502:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8abffe3d4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788211770.627576:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2357:x1875075637747584:12345-192.168.204.29@tcp:8:lhsmtool_posix.0 Request processed in 515us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211770.627584:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:0.0:1788211770.634673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211770.634748:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637747712 00000100:00100000:1.0:1788211770.634759:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637747712 00000100:00100000:1.0:1788211770.634839:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:1.0:1788211770.634851:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:0:x1875075637747712:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788211770.635210:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788211770.730731:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:0:x1875075637747712:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 95868us (96055us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788211770.730748:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 25 00000001:00080000:2.0:1788211770.730946:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1788211770.730962:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000100:00100000:0.0:1788211770.734555:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211770.736514:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637747968 00000100:00100000:3.0:1788211770.736542:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637747968 00000100:00100000:3.0:1788211770.736748:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:3.0:1788211770.736761:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:10460:x1875075637747968:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788211770.737147:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10460:x1875075637747968:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 388us (2605us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788211770.737156:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:0.0:1788211770.740609:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211770.740773:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637748224 00000100:00100000:2.0:1788211770.740782:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637748224 00000100:00100000:2.0:1788211770.740903:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:2.0:1788211770.740916:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10460:x1875075637748224:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788211770.741087:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10460:x1875075637748224:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 175us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211770.741111:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:0.0:1788211770.756891:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211770.757687:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637748352 00000100:00100000:3.0:1788211770.757703:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637748352 00000100:00100000:3.0:1788211770.757839:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:3.0:1788211770.757850:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10460:x1875075637748352:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788211770.757876:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211770.757914:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ab7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f58f9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.758014:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5abe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.758032:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.758048:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211770.758095:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211770.758120:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.758151:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ab7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58f9 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.758215:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58f9 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.758226:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:3.0:1788211770.758229:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788211770.758233:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063400, rc 0) 00000100:00100000:3.0:1788211770.758320:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:10460:x1875075637748352:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 471us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211770.758328:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:2.0:1788211770.765472:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211770.765578:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637748480 00000100:00100000:3.0:1788211770.765591:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637748480 00000100:00100000:3.0:1788211770.766116:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:3.0:1788211770.766129:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637748480:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788211770.766149:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211770.766219:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a5ac5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5900 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788211770.766262:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95f23a, blocks: 0x1 00010000:00010000:3.0:1788211770.766287:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1788211770.766293:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211770.766304:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a5ac5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5900 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.766331:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a5ac5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5900 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.766362:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062000, rc 0) 00000100:00100000:3.0:1788211770.766446:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637748480:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 320us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211770.766455:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:1.0:1788211770.798440:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211770.798551:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637748736 00000100:00100000:0.0:1788211770.798564:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637748736 00000100:00100000:0.0:1788211770.798651:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:0.0:1788211770.798664:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:10460:x1875075637748736:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788211770.798826:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:10460:x1875075637748736:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 165us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211770.798836:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:3.0:1788211770.802950:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211770.805766:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637748864 00000100:00100000:1.0:1788211770.806728:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637748864 00000100:00100000:1.0:1788211770.807008:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:1.0:1788211770.807022:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:10460:x1875075637748864:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788211770.807044:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211770.807068:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5907 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211770.807109:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a5ac5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5900 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211770.807119:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211770.807123:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211770.807129:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5907 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211770.807281:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a5ac5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5900 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211770.807300:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a5ac5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5900 expref: 7 pid: 6695 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211770.807318:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875075660841600:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211770.807505:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe489d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788211770.814416:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875075660841600:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211770.814471:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5907 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211770.814502:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06400, rc 0) 00000100:00100000:2.0:1788211770.815369:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:10460:x1875075637748864:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 8343us (12432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211770.815382:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:2.0:1788211770.816329:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211770.817150:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637748992 00000100:00100000:0.0:1788211770.817221:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637748992 00010000:00010000:0.0:1788211770.817281:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a5ac5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5900 expref: 7 pid: 6695 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211770.817383:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:0.0:1788211770.817397:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637748992:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211770.817416:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211770.817445:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a5ac5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5900 expref: 7 pid: 6695 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.817461:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a5ac5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5900 expref: 7 pid: 6695 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.817493:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a5ac5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5900 expref: 7 pid: 6695 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.817510:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211770.817515:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211770.817524:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5907 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.817535:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5907 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211770.817584:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5907 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211770.817612:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1875075660841728:192.168.204.29@tcp:105: 00000100:00100000:0.0:1788211770.817729:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9ccb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211770.828288:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1875075660841728:192.168.204.29@tcp:105: 00010000:00010000:2.0:1788211770.828319:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211770.828398:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637748992:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 11003us (12073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211770.828412:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:2.0:1788211770.844863:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211770.845106:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637749120 00000100:00100000:3.0:1788211770.845118:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637749120 00002000:00100000:3.0:1788211770.845352:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8ac0010a2d80 x1875075637749120/t0(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:321/0 lens 504/0 e 0 to 0 dl 1788211781 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211770.845366:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac0010a2d80 with x1875075637749120 ext(0->8) 00002000:00010000:3.0:1788211770.845373:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ac0010a2d80 00000100:00100000:3.0:1788211770.845414:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:3.0:1788211770.845429:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637749120:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788211770.846291:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637749120:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 Request processed in 857us (1436us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788211770.846305:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00002000:00100000:3.0:1788211770.846315:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8ac0010a2d80 x1875075637749120/t4294967302(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:321/0 lens 504/448 e 0 to 0 dl 1788211781 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211770.846325:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac0010a2d80 with x1875075637749120 ext(0->8) 00002000:00010000:3.0:1788211770.846330:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ac0010a2d80 00000100:00100000:2.0:1788211770.852564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211770.852613:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637749248 00000100:00100000:2.0:1788211770.852624:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637749248 00000100:00100000:2.0:1788211770.852734:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:2.0:1788211770.852746:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:10460:x1875075637749248:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 00000040:00080000:3.0:1788211770.891426:0:12011:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788211770.891437:0:12011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788211770.891494:0:12011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788211770.891504:0:12011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788211770.912250:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:1.0:1788211770.912323:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788211770.912349:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8abec677b540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788211770.912356:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abffdc13a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8abff65790c0 00000020:00080000:1.0:1788211770.912360:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abffdc13700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8abffe3f1800 00000001:00080000:1.0:1788211770.912385:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788211770.912392:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788211770.912481:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1788211770.912567:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660841856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788211770.912861:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211770.912931:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788211770.912938:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660841984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788211770.912963:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211770.913161:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660841856 00000100:00100000:2.0:1788211770.913202:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660841856 00000100:00100000:2.0:1788211770.913273:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660841984 00000100:00100000:2.0:1788211770.913283:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660841984 00000100:00100000:3.0:1788211770.913295:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:10460:x1875075637749248:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 Request processed in 60545us (60741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211770.913309:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:2.0:1788211770.913311:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788211770.913320:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660841856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788211770.913347:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788211770.913355:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660841984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788211770.913375:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788211770.913418:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a95f236, atime: 0x6a95f236, ctime: 0x6a95f236, blocks: 0xb 00010000:00010000:3.0:1788211770.913428:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5bb7c37/0x2afbce82f55a5ad3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.913452:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1788211770.913458:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211770.913467:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5bb7c37/0x2afbce82f55a5ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.913486:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5bb7c37/0x2afbce82f55a5ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.913497:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5bb7c37/0x2afbce82f55a5ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211770.913505:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5bb7c37/0x2afbce82f55a5ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788211770.913516:0:8290:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788211770.913519:0:8290:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788211770 00002000:00010000:2.0:1788211770.913522:0:8290:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788211770.913525:0:8290:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788211770 -> 1788211770 00010000:00010000:3.0:1788211770.913528:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788211770.913528:0:8290:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000020:00080000:0.0:1788211770.913563:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788211770.913578:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660841856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 258us (794us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788211770.913585:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788211770.913605:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788211770.913609:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788211770.913655:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abfef9aa300/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788211770.913662:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660841856:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788211770.914461:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211770.914470:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5bb7c37/0x2afbce82f55a5ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211770.914483:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211770.914489:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5bb7c37/0x2afbce82f55a5ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211770.914499:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5bb7c37/0x2afbce82f55a5ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211770.914524:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5bb7c37/0x2afbce82f55a5ad3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211770.914537:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5bb7c37/0x2afbce82f55a5ad3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211770.914558:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211770.914560:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211770.914562:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211770.914591:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660841984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1234us (1624us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788211770.914605:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1788211770.914751:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac0010a1500/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788211770.914758:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660841984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788211770.922039:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211770.922444:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637749376 00000100:00100000:2.0:1788211770.922538:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637749376 00000100:00100000:2.0:1788211770.922716:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:2.0:1788211770.922731:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2358:x1875075637749376:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788211771.048011:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1788211771.048031:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1788211771.048314:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637749376:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 Request processed in 125580us (126282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211771.048336:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:3.0:1788211771.063301:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211771.063516:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637749632 00000100:00100000:0.0:1788211771.063528:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637749632 00000100:00100000:0.0:1788211771.063598:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:0.0:1788211771.063609:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:10460:x1875075637749632:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788211771.063671:0:9952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211771.063702:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5abe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58f9 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211771.063721:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:0.0:1788211771.063726:0:9952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788211771.063758:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a5ada lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211771.063771:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a5ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211771.063781:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a5ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788211771.064042:0:9952:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abba263f reply state 0000000008742a11 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a5ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211771.064076:0:9952:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788211771.064203:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:10460:x1875075637749632:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 595us (914us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788211771.064211:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 81 00010000:00010000:2.0:1788211771.073065:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a5ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.073125:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a5ada lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.073226:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a5ada lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.073234:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cca00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211771.073239:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a5ada lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.073248:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a5ada lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.073302:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:2.0:1788211771.073306:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211771.073348:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a5ada lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.073356:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a5ada lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211771.075320:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211771.076351:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637749760 00000100:00100000:2.0:1788211771.076363:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637749760 00000100:00100000:2.0:1788211771.076414:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:2.0:1788211771.076425:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637749760:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788211771.076709:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788211771.076713:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788211770 -> 1788211768 00002000:00010000:2.0:1788211771.076716:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788211766 00002000:00010000:2.0:1788211771.076718:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788211770 -> 1788211768 00002000:00010000:2.0:1788211771.076720:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788211771.076796:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637749760:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 372us (1484us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788211771.076804:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:3.0:1788211771.090382:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211771.090698:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637750016 00000100:00100000:2.0:1788211771.090711:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637750016 00000100:00100000:2.0:1788211771.090777:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 82 00000100:00100000:2.0:1788211771.090806:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:10460:x1875075637750016:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788211771.090969:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.091017:0:6717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5a9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58eb expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.091028:0:6717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.091134:0:6717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58eb expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.091163:0:6717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5a9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58eb expref: 13 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211771.091232:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660842112:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211771.091365:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc63826c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211771.094456:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660842112:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211771.094502:0:6717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211771.098133:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211771.098394:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637750144 00000100:00100000:2.0:1788211771.098406:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637750144 00010000:00010000:2.0:1788211771.098465:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5a9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58eb expref: 14 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211771.098510:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:2.0:1788211771.098521:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe056d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:2359:x1875075637750144:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211771.098543:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211771.098552:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5a9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58eb expref: 14 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.098569:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58eb expref: 14 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.098604:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5a9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58eb expref: 14 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.098627:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:2.0:1788211771.098650:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.098662:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.098670:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.098700:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211771.098770:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe056d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:2359:x1875075637750144:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 249us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211771.098779:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00010000:00010000:3.0:1788211771.098947:0:6717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.098956:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.098994:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.099000:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.099007:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.099014:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211771.099018:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.099037:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.099050:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:3.0:1788211771.099053:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788211771.099057:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.099063:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5ae1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211771.099123:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+12:10460:x1875075637750016:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 Request processed in 8334us (10548us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788211771.099133:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 82 00000100:00100000:3.0:1788211771.109121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211771.109231:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637750272 00000100:00100000:0.0:1788211771.109241:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637750272 00000100:00100000:0.0:1788211771.109295:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:0.0:1788211771.109303:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2358:x1875075637750272:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788211771.109354:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211771.109374:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5907 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211771.109382:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211771.109387:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788211771.109391:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211771.109422:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5907 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211771.109435:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5907 expref: 7 pid: 6696 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211771.109450:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875075660842240:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211771.109540:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9cccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211771.110777:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788211771.110794:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660842368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211771.110845:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211771.111117:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660842368 00000100:00100000:0.0:1788211771.111124:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660842368 00000100:00100000:0.0:1788211771.111208:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788211771.111218:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875075660842368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788211771.111252:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211771.111302:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875075660842368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211771.111309:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788211771.111625:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660842368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211771.114250:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875075660842240:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211771.114279:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211771.118002:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211771.118521:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637750400 00000100:00100000:2.0:1788211771.118533:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637750400 00010000:00010000:2.0:1788211771.118576:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5907 expref: 8 pid: 6696 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211771.118632:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:2.0:1788211771.118642:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2358:x1875075637750400:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211771.118658:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211771.118681:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5907 expref: 8 pid: 6696 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.118696:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5907 expref: 8 pid: 6696 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.118739:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084c0e04c/0x2afbce82f55a5acc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5907 expref: 8 pid: 6696 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.118754:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788211771.118759:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788211771.118764:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.118772:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.118803:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211771.118860:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2358:x1875075637750400:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 219us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211771.118868:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 44 00010000:00010000:1.0:1788211771.119610:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.119624:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.119653:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.119662:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.119670:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.119678:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788211771.119684:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.119693:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.119708:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.119732:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a5ae8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211771.119803:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637750272:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 Request processed in 10499us (10692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211771.119812:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:3.0:1788211771.124668:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211771.124753:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637750656 00000100:00100000:2.0:1788211771.124764:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637750656 00000100:00100000:2.0:1788211771.124837:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:2.0:1788211771.124848:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+12:10460:x1875075637750656:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788211771.124954:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5aef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.124974:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5aef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.124989:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5aef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.125294:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.125307:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5aa9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58f2 expref: 13 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.125316:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.125486:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58f2 expref: 13 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.125499:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58f2 expref: 13 pid: 9952 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211771.125512:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660842496:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211771.125652:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc63826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211771.137637:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660842496:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211771.137691:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211771.138309:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211771.138703:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637750784 00000100:00100000:1.0:1788211771.138713:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637750784 00010000:00010000:1.0:1788211771.138750:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58f2 expref: 14 pid: 9952 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211771.138795:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:1.0:1788211771.138805:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:2359:x1875075637750784:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211771.138821:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211771.138829:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58f2 expref: 14 pid: 9952 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.138842:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58f2 expref: 14 pid: 9952 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.138867:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a5aa9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58f2 expref: 14 pid: 9952 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.138960:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:1.0:1788211771.138967:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.138978:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.138987:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.139014:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211771.139052:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211771.139060:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211771.139084:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:2359:x1875075637750784:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 280us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211771.139090:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 45 00000001:00080000:2.0:1788211771.140299:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788211771.141730:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788211771.141814:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788211771.142058:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1875075660842624:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788211771.142136:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211771.142271:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660842624 00000100:00100000:1.0:1788211771.142280:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660842624 00000100:00100000:2.0:1788211771.142285:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788211771.142338:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788211771.142349:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875075660842624:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788211771.142452:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875075660842624:12345-0@lo:1000:mdt00_002.0 Request processed in 104us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211771.142460:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788211771.142485:0:5845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788211771.142493:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abfef9aa300, transno 4294967303 00000100:00100000:2.0:1788211771.142512:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1875075660842624:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788211771.143092:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788211771.143152:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1875075660842752:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788211771.143232:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211771.143255:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788211771.143318:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660842752 00000100:00100000:0.0:1788211771.143324:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660842752 00000100:00100000:0.0:1788211771.143507:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788211771.143517:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875075660842752:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788211771.143716:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1875075660842752:12345-0@lo:1000:mdt00_002.0 Request processed in 200us (482us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788211771.143723:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788211771.143790:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1875075660842752:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788211771.143835:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.143848:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.143871:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.143878:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211771.143884:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.143969:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.143994:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:3.0:1788211771.143998:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788211771.144004:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144011:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5af6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144054:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a5a24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144061:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a5a24 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144066:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a5a24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144071:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211771.144074:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a5a24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144091:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a5a24 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144101:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec800) 00010000:00010000:3.0:1788211771.144282:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788211771.144287:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a5a24 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144293:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06600/0x2afbce82f55a5a24 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144320:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144336:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58d6 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144346:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144380:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58d6 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.144397:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58d6 expref: 16 pid: 5845 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211771.144410:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe056300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660842880:192.168.204.29@tcp:104: 00000100:00100000:3.0:1788211771.144496:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcb07ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788211771.148534:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211771.148580:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637750912 00000100:00100000:3.0:1788211771.148601:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637750912 00010000:00010000:3.0:1788211771.148642:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58d6 expref: 17 pid: 5845 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211771.148676:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:3.0:1788211771.148687:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:2359:x1875075637750912:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211771.148702:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211771.148710:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58d6 expref: 17 pid: 5845 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.148724:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58d6 expref: 17 pid: 5845 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.148749:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec800) 00010000:00010000:3.0:1788211771.148755:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.148766:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.148773:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.148794:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211771.148870:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:2359:x1875075637750912:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 184us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211771.148879:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 46 00010000:00010000:1.0:1788211771.149421:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5a40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f58d6 expref: 16 pid: 5845 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211771.149438:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe056300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660842880:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211771.149457:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149477:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149483:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149496:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149503:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149509:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149514:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211771.149519:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149526:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149536:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec800) 00010000:00010000:1.0:1788211771.149539:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211771.149542:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149549:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5afd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149559:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5aef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149570:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5aef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149576:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5aef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149640:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211771.149644:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5aef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149651:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5aef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149660:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ec800) 00010000:00010000:1.0:1788211771.149662:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788211771.149665:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5aef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.149671:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5aef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211771.149959:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:10460:x1875075637750656:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 25112us (25301us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788211771.149969:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 83 00000020:00080000:1.0:1788211771.149973:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788211771.150125:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788211771.150135:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788211771.150205:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788211771.150212:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788211771.156160:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211771.156239:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637751168 00000100:00100000:1.0:1788211771.156249:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637751168 00000100:00100000:1.0:1788211771.156309:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:1.0:1788211771.156319:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:10460:x1875075637751168:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788211771.157024:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788211771.157127:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788211771.157203:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.157220:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.157232:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.157241:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b04 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.157247:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b04 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.157252:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211771.157279:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788211771.157369:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:10460:x1875075637751168:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 1049us (1216us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788211771.157378:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00000020:00080000:1.0:1788211771.157383:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788211771.157410:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211771.157418:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.157426:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211771.157430:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.157438:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.157452:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abfc37ec800) 00010000:00010000:3.0:1788211771.157455:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788211771.157460:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b04 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.157466:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211771.157481:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211771.157483:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211771.157485:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211771.558134:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211771.628682:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660843008:0@lo:400:kworker.0 00000100:00100000:2.0:1788211771.628775:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211771.628855:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660843264:0@lo:400:kworker.0 00000100:00100000:2.0:1788211771.628890:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211771.628916:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788211771.628921:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660843136:0@lo:400:kworker.0 00000100:00100000:2.0:1788211771.628970:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211771.629005:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660843008 00000100:00100000:2.0:1788211771.629014:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660843008 00000100:00100000:2.0:1788211771.629071:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788211771.629083:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3309:x1875075660843008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211771.629141:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3309:x1875075660843008:12345-0@lo:400:kworker.0 Request processed in 60us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211771.629148:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788211771.629490:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660843264 00000100:00100000:0.0:1788211771.629495:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660843264 00000100:00100000:0.0:1788211771.630127:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660843136 00000100:00100000:0.0:1788211771.630133:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660843136 00000100:00100000:0.0:1788211771.630197:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788211771.630207:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660843264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211771.630366:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660843264:12345-0@lo:400:kworker.0 Request processed in 160us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211771.630388:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788211771.630406:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788211771.630412:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660843136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211771.630443:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660843136:12345-0@lo:400:kworker.0 Request processed in 31us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211771.630449:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1788211771.630472:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211771.630961:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660843392:0@lo:400:kworker.0 00000100:00100000:1.0:1788211771.631015:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211771.631069:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660843392 00000100:00100000:1.0:1788211771.631075:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660843392 00000100:00100000:1.0:1788211771.631127:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788211771.631146:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660843392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211771.631225:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660843392:12345-0@lo:400:kworker.0 Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211771.631232:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788211771.631264:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660843392:0@lo:400:kworker.0 00000100:00080000:1.0:1788211771.631412:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211771.632314:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660843008:0@lo:400:kworker.0 00000100:00100000:0.0:1788211771.632410:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660843136:0@lo:400:kworker.0 00000100:00100000:0.0:1788211771.632446:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660843264:0@lo:400:kworker.0 00000100:00100000:0.0:1788211772.133740:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660843520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788211772.133840:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211772.134079:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660843520 00000100:00100000:3.0:1788211772.134090:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660843520 00000100:00100000:3.0:1788211772.134236:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788211772.134252:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875075660843520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211772.134360:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211772.134447:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875075660843520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211772.134457:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788211772.134537:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788211772.134618:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660843520:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788211772.582799:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211772.637963:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211772.638005:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211772.638071:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211772.638100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211772.638123:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211772.638197:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637751808 00000100:00100000:3.0:1788211772.638207:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637751808 00000100:00100000:3.0:1788211772.638279:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637751424 00000100:00100000:3.0:1788211772.638283:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637751424 00000100:00100000:1.0:1788211772.638292:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637751296 00000100:00100000:3.0:1788211772.638309:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 147 00000100:00100000:1.0:1788211772.638309:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637751296 00000100:00100000:3.0:1788211772.638324:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2359:x1875075637751808:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211772.638362:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 291 00000100:00100000:1.0:1788211772.638373:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637751296:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211772.638409:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2359:x1875075637751808:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 87us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211772.638421:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 147 00000100:00100000:1.0:1788211772.638421:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637751296:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 48us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211772.638433:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 291 00000100:00100000:3.0:1788211772.638448:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 148 00000100:00100000:3.0:1788211772.638458:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:2359:x1875075637751424:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211772.638492:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:2359:x1875075637751424:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 36us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211772.638498:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 148 00000100:00080000:3.0:1788211772.638517:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211772.644810:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637751552 00000100:00100000:2.0:1788211772.644827:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637751552 00000100:00100000:2.0:1788211772.645034:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637751680 00000100:00100000:2.0:1788211772.645038:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637751680 00000100:00080000:1.0:1788211772.645061:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211772.645065:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788211772.645151:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:2.0:1788211772.645163:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637751552:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211772.645265:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637751552:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 104us (7259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211772.645272:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:2.0:1788211772.645291:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00100000:2.0:1788211772.645307:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637751680:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211772.645332:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637751680:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 35us (7208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211772.645347:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 66 00000001:00080000:3.0:1788211772.690122:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000040:00080000:3.0:1788211772.724567:0:12065:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788211772.724576:0:12065:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788211772.724621:0:12065:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788211772.724627:0:12065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788211772.887523:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211772.887643:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637752064 00000100:00100000:0.0:1788211772.887656:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637752064 00000100:00100000:0.0:1788211772.887727:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:0.0:1788211772.887738:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:10480:x1875075637752064:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788211772.887758:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211772.887778:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f590e expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.888102:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5b12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.888119:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5b12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.888148:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5b12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211772.888162:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1788211772.888368:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f590e expref: 20 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.888384:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5b12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f590e expref: 19 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.888394:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:0.0:1788211772.888397:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788211772.888401:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cde00, rc 0) 00000100:00100000:0.0:1788211772.891795:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:10480:x1875075637752064:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4045us (4269us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788211772.891811:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:2.0:1788211772.895742:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211772.895809:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637752192 00000100:00100000:3.0:1788211772.895818:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637752192 00000100:00100000:3.0:1788211772.895896:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:3.0:1788211772.895906:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:10480:x1875075637752192:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1788211772.895990:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5b20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.896007:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5b20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.896019:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5b20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.896033:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5b27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.896041:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.896048:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.897361:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5b2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.897377:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.897388:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788211772.897440:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.897455:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5b20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.897470:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5b20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.897478:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5b20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.897484:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063a00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211772.897489:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5b20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.897497:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5b20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.897510:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:3.0:1788211772.897513:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211772.897518:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5b20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.897525:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5b20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.897537:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.897543:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5b27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.898117:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5b27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.898124:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211772.898146:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5b27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.898154:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5b27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.898378:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc5bbe500) 00010000:00010000:3.0:1788211772.898383:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211772.898387:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5b27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.898394:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5b27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.898415:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.898421:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5b2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.898427:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.898433:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211772.898435:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.898442:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5b2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.898449:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe400) 00010000:00010000:3.0:1788211772.898452:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211772.898460:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5b2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.898466:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5b2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211772.899306:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:10480:x1875075637752192:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 3388us (3560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211772.899317:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:2.0:1788211772.946204:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211772.946509:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637752448 00000100:00100000:3.0:1788211772.946523:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637752448 00000100:00100000:3.0:1788211772.946597:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00100000:3.0:1788211772.946607:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:10483:x1875075637752448:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211772.946631:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211772.946655:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5b35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5915 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.946738:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5b3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.946754:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5b3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.946765:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5b3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.946778:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.946784:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.946802:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947163:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5b4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947195:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947203:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211772.947213:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788211772.947609:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5b3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947618:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5b3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947625:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947631:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211772.947635:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947643:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5b3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947656:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:3.0:1788211772.947659:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211772.947671:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5b3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947677:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a5b3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947690:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947695:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5b43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947700:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947704:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211772.947707:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947712:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947720:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc5bbe800) 00010000:00010000:3.0:1788211772.947722:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211772.947724:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5b43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947729:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5b43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947770:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5b35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5915 expref: 22 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947793:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5b4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5915 expref: 21 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211772.947801:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211772.947803:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211772.947806:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062800, rc 0) 00000100:00100000:3.0:1788211772.948066:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:10483:x1875075637752448:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1458us (1902us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788211772.948075:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00100000:2.0:1788211772.953098:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211772.953188:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637752576 00000100:00100000:0.0:1788211772.953200:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637752576 00000100:00100000:0.0:1788211772.953261:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 87 00000100:00100000:0.0:1788211772.953272:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:10483:x1875075637752576:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:0.0:1788211772.953348:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.953371:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.953383:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.953412:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.953419:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.953426:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.953432:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cce00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211772.953436:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.953443:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.953454:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:0.0:1788211772.953457:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788211772.953460:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.953466:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211772.953538:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:10483:x1875075637752576:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 268us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211772.953552:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 87 00000100:00100000:3.0:1788211772.958538:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211772.958977:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637752832 00000100:00100000:1.0:1788211772.958987:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637752832 00000100:00100000:1.0:1788211772.959086:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:1.0:1788211772.959095:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc64f8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:10483:x1875075637752832:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1788211772.959391:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc64f8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:10483:x1875075637752832:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 296us (858us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788211772.959423:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1788211772.986110:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211772.986362:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637753088 00000100:00100000:1.0:1788211772.986374:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637753088 00000100:00100000:1.0:1788211772.986523:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:1.0:1788211772.986541:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:10001:x1875075637753088:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788211772.986567:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211772.986588:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5b5f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f591c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211772.986701:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211772.986717:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5b4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5915 expref: 23 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211772.986726:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211772.986761:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5b4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5915 expref: 23 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211772.986775:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5b4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5915 expref: 23 pid: 6717 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211772.986788:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660843648:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211772.986898:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ac0020c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211772.991264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211772.991293:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660843648:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211772.991322:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211772.991454:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637753216 00000100:00100000:0.0:1788211772.991464:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637753216 00010000:00010000:0.0:1788211772.991508:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5b4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5915 expref: 24 pid: 6717 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211772.991549:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:0.0:1788211772.991560:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+24:2358:x1875075637753216:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211772.991574:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211772.991582:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5b4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5915 expref: 24 pid: 6717 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.991594:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5b4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5915 expref: 24 pid: 6717 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.991616:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a5b4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5915 expref: 24 pid: 6717 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.991631:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:0.0:1788211772.991636:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.991644:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.991651:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.991682:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211772.991745:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:2358:x1875075637753216:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 185us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211772.991752:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00010000:00010000:0.0:1788211772.991777:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.991783:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211772.991802:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788211772.991965:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5b5f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f591c expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.991980:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f591c expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211772.991987:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:0.0:1788211772.991990:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788211772.991992:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06800, rc 0) 00000100:00100000:0.0:1788211772.992017:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:10001:x1875075637753088:12345-192.168.204.29@tcp:101:bash.0 Request processed in 5480us (5918us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788211772.992024:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:1.0:1788211772.994634:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211772.994725:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637753472 00000100:00100000:0.0:1788211772.994738:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637753472 00000100:00100000:0.0:1788211772.994804:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 89 00000100:00100000:0.0:1788211772.994816:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:10001:x1875075637753472:12345-192.168.204.29@tcp:36:bash.0 00010000:00010000:1.0:1788211772.995740:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5b74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211772.995767:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211772.995795:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788211772.996039:0:6717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788211772.996077:0:6717:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002bbe61b7 reply state 00000000fa8dec13 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211772.996089:0:6717:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788211772.996160:0:6717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788211772.996640:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+27:10001:x1875075637753472:12345-192.168.204.29@tcp:36:bash.0 Request processed in 1821us (2013us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788211772.996651:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 89 00000020:00080000:1.0:1788211772.996657:0:6717:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788211773.001461:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.001484:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5b74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.001492:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5b74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.001499:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211773.001505:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5b74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.001514:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5b74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.001535:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211773.001538:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211773.001552:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5b74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.001559:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5b74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211773.002139:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211773.002285:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637753600 00000100:00100000:0.0:1788211773.002299:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637753600 00000100:00100000:0.0:1788211773.002401:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 90 00000100:00100000:0.0:1788211773.002414:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:10001:x1875075637753600:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1788211773.002445:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211773.002470:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5b7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5923 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.002539:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5b7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5923 expref: 27 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.002554:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5b7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5923 expref: 27 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.002575:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:0.0:1788211773.002578:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788211773.002581:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd400, rc 0) 00000100:00100000:0.0:1788211773.002725:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+27:10001:x1875075637753600:12345-192.168.204.29@tcp:101:bash.0 Request processed in 313us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211773.002732:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 90 00000100:00100000:2.0:1788211773.010380:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211773.010466:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637753728 00000100:00100000:1.0:1788211773.010481:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637753728 00000100:00100000:1.0:1788211773.010550:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:1.0:1788211773.010562:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:10001:x1875075637753728:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788211773.010580:0:8290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211773.010604:0:8290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce41081a/0x2afbce82f55a5b82 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f592a expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788211773.010635:0:8290:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a95f238, atime: 0x6a95f236, ctime: 0x6a95f238, blocks: 0xb 00010000:00010000:1.0:1788211773.010662:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:1.0:1788211773.010666:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211773.010675:0:8290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce41081a/0x2afbce82f55a5b82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f592a expref: 7 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.010712:0:8290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce41081a/0x2afbce82f55a5b82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f592a expref: 7 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.010728:0:8290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06600, rc 0) 00000100:00100000:1.0:1788211773.010795:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:10001:x1875075637753728:12345-192.168.204.29@tcp:101:bash.0 Request processed in 236us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211773.010802:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:3.0:1788211773.017049:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211773.017091:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637753856 00000100:00100000:3.0:1788211773.017102:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637753856 00002000:00010000:3.0:1788211773.017160:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788211773.017181:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abffe054380 with x1875075637753856 ext(0->18446744073709551615) 00002000:00010000:3.0:1788211773.017195:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8abffe054380. 00000100:00100000:3.0:1788211773.017234:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:3.0:1788211773.017245:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637753856:12345-192.168.204.29@tcp:10:bash.0 00002000:00010000:3.0:1788211773.017736:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788211773.017741:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788211768 -> 1788211772 00002000:00010000:3.0:1788211773.017744:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788211766 -> 1788211766 00002000:00010000:3.0:1788211773.017746:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788211768 -> 1788211772 00002000:00010000:3.0:1788211773.017749:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788211773.017821:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637753856:12345-192.168.204.29@tcp:10:bash.0 Request processed in 575us (783us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788211773.017830:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00002000:00010000:3.0:1788211773.017833:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788211773.017836:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abffe054380 with x1875075637753856 ext(0->18446744073709551615) 00002000:00010000:3.0:1788211773.017841:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8abffe054380. 00000100:00100000:1.0:1788211773.130138:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211773.130381:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637753984 00000100:00100000:0.0:1788211773.130393:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637753984 00000100:00100000:0.0:1788211773.130467:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 91 00000100:00100000:0.0:1788211773.130479:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+27:10497:x1875075637753984:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1788211773.130587:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5b89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.130631:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5b89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.130642:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5b89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.130658:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5b90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.130666:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.130671:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131358:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131369:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131378:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788211773.131422:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131435:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5b89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131442:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5b89 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131460:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5b89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131466:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211773.131470:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5b89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131478:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5b89 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131492:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:0.0:1788211773.131495:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211773.131500:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5b89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131507:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a5b89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131519:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131525:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5b90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131530:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131535:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cda00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211773.131537:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131614:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5b90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131623:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfdb434800) 00010000:00010000:0.0:1788211773.131625:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211773.131628:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5b90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131634:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5b90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131649:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131654:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131659:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131664:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cce00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211773.131667:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131672:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131677:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:0.0:1788211773.131679:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211773.131682:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.131698:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5b97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211773.131798:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+27:10497:x1875075637753984:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1318us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211773.131808:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 91 00000100:00100000:2.0:1788211773.164123:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211773.164323:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637754240 00000100:00100000:1.0:1788211773.164337:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637754240 00000100:00100000:1.0:1788211773.164422:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 92 00000100:00100000:1.0:1788211773.164437:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+27:10500:x1875075637754240:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1788211773.164468:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211773.164500:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5b9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5931 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.164712:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5ba5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.164730:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.164741:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.164758:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5bac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.164781:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.164789:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.165157:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5bb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.165724:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.165738:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211773.165752:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788211773.166344:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166357:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5ba5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166365:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166372:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211773.166377:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166385:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5ba5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166532:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:1.0:1788211773.166535:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211773.166609:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5ba5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166618:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a5ba5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166635:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166641:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5bac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166647:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166652:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211773.166655:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166661:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5bac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166669:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc37ec300) 00010000:00010000:1.0:1788211773.166672:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211773.166675:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5bac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166681:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07c00/0x2afbce82f55a5bac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166751:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a5b9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5931 expref: 30 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166768:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5931 expref: 29 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.166777:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:1.0:1788211773.166779:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788211773.166783:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37a800, rc 0) 00000100:00100000:1.0:1788211773.166991:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+29:10500:x1875075637754240:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2556us (2878us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788211773.167001:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 92 00000100:00100000:3.0:1788211773.172321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211773.172514:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637754368 00000100:00100000:0.0:1788211773.172525:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637754368 00000100:00100000:0.0:1788211773.172598:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 93 00000100:00100000:0.0:1788211773.172608:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+29:10500:x1875075637754368:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:0.0:1788211773.172680:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.172697:0:9952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f591c expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.172706:0:9952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.172740:0:9952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f591c expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.172755:0:9952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f591c expref: 29 pid: 5845 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211773.172769:0:9952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9952:1875075660843776:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211773.172875:0:9952:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9cccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211773.175629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211773.175848:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637754624 00000100:00100000:1.0:1788211773.175861:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637754624 00000100:00100000:1.0:1788211773.175931:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:1.0:1788211773.175943:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+30:5600:x1875075637754624:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788211773.176398:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:5600:x1875075637754624:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 457us (782us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788211773.176408:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:0.0:1788211773.176702:0:9952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9952:1875075660843776:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211773.176730:0:9952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211773.179388:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211773.179685:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637754752 00000100:00100000:3.0:1788211773.179714:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637754752 00010000:00010000:3.0:1788211773.179764:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f591c expref: 31 pid: 5845 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211773.179816:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:3.0:1788211773.179840:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:2358:x1875075637754752:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211773.179856:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211773.179864:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f591c expref: 31 pid: 5845 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.179879:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f591c expref: 31 pid: 5845 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.179902:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a5b66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f591c expref: 31 pid: 5845 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.179920:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211773.179924:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.179935:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.179943:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.179979:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211773.180040:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+30:2358:x1875075637754752:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 214us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211773.180058:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 48 00010000:00010000:1.0:1788211773.181045:0:9952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.181058:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.181112:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.181120:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.181141:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.181147:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cce00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211773.181152:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.181160:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.181213:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:1.0:1788211773.181216:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788211773.181221:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.181228:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cce00/0x2afbce82f55a5bc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211773.181322:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+29:10500:x1875075637754368:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 8709us (9009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211773.181332:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 93 00000100:00100000:1.0:1788211773.193861:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211773.194009:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637755008 00000100:00100000:0.0:1788211773.194022:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637755008 00000100:00100000:0.0:1788211773.194084:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:0.0:1788211773.194094:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+29:10500:x1875075637755008:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1788211773.194437:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+30:10500:x1875075637755008:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 342us (586us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788211773.194446:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:3.0:1788211773.314485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211773.314893:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637755264 00000100:00100000:0.0:1788211773.314905:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637755264 00000100:00100000:0.0:1788211773.314976:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 94 00000100:00100000:0.0:1788211773.314987:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+30:10511:x1875075637755264:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1788211773.315027:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211773.315060:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5bc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5938 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.317911:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bcf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.317969:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.317984:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.318007:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5bd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.318014:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.318021:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.318768:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5bdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.318780:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.318789:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211773.318804:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788211773.319366:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319376:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bcf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319384:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319399:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211773.319404:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319414:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bcf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319431:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:1.0:1788211773.319434:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211773.319438:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319444:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319460:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319467:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5bd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319473:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319478:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211773.319480:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319486:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319502:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc37ec300) 00010000:00010000:1.0:1788211773.319504:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211773.319507:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5bd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319512:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5bd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319704:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5bc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5938 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319721:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5938 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.319728:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:1.0:1788211773.319730:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788211773.319732:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37a000, rc 0) 00000100:00100000:1.0:1788211773.320014:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+32:10511:x1875075637755264:12345-192.168.204.29@tcp:101:cat.0 Request processed in 5026us (5548us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788211773.320024:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 94 00000100:00100000:2.0:1788211773.325379:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211773.325484:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637755520 00000100:00100000:0.0:1788211773.325496:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637755520 00000100:00100000:0.0:1788211773.325726:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:0.0:1788211773.325740:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+32:10511:x1875075637755520:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:0.0:1788211773.326272:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+33:10511:x1875075637755520:12345-192.168.204.29@tcp:35:cat.0 Request processed in 533us (900us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788211773.326281:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:2.0:1788211773.346623:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211773.346720:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637755776 00000100:00100000:1.0:1788211773.346730:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637755776 00000100:00100000:1.0:1788211773.346799:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 95 00000100:00100000:1.0:1788211773.346811:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+33:10512:x1875075637755776:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:1.0:1788211773.346897:0:6717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788211773.346928:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5bdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5938 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.346972:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5bb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5931 expref: 32 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.346983:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a5b7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5923 expref: 31 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.346994:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:1.0:1788211773.347003:0:6717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788211773.347025:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5beb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.347038:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5beb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.347048:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5beb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.347060:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bf2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.347066:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.347073:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.347825:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5bf9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.347848:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.347865:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788211773.349038:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1788211773.349050:0:6717:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362654883098ns, next at 363654880600ns, rc = 0 00010000:00010000:1.0:1788211773.349136:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5c00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.349149:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.349158:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.349453:0:6717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5c00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.349462:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5c00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.349469:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.349484:0:6717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788211773.349510:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.349516:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5bf9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.349523:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5bf9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.351225:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211773.351237:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5c00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.351262:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ba00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211773.351266:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5c00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.351276:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.351470:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ece00) 00010000:00010000:2.0:1788211773.351474:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788211773.351480:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5c00 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.351488:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5c00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.351508:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211773.351510:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211773.351512:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211773.351667:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211773.351676:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5bf9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.351683:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5bf9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.351693:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8abfc37ece00) 00010000:00010000:1.0:1788211773.351696:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788211773.351699:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5bf9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.351706:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5bf9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.351740:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5beb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.351748:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5beb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.351756:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5beb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.351762:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211773.351764:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5beb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.351771:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5beb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.351793:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:1.0:1788211773.351795:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211773.351798:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5beb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.351804:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5beb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788211773.351817:0:6717:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eeeba78d reply state 0000000008b20b96 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211773.352029:0:6717:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788211773.357486:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.357503:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bf2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.357512:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.357517:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211773.357522:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.357557:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bf2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.357575:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc37ec300) 00010000:00010000:2.0:1788211773.357578:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211773.357582:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bf2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.357589:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5bf2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211773.357721:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:10512:x1875075637755776:12345-192.168.204.29@tcp:36:rm.0 Request processed in 10906us (11108us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788211773.357732:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 95 00000100:00100000:2.0:1788211773.424231:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211773.424387:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637756032 00000100:00100000:1.0:1788211773.424398:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637756032 00000100:00100000:1.0:1788211773.424464:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 96 00000100:00100000:1.0:1788211773.424476:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:10518:x1875075637756032:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788211773.424500:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211773.424521:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5c07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f593f expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.424925:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.424942:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.428863:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.428914:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5c15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.428931:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.428942:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788211773.440828:0:9952:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788211773.441046:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5c1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.441062:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.441075:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.441115:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.441135:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.441143:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.441149:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211773.441703:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.441716:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.441735:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:1.0:1788211773.441739:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211773.441743:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.441750:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788211773.441769:0:9952:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c65a82c reply state 000000006e7bc9f8 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211773.441781:0:9952:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788211773.441833:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5c07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f593f expref: 34 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.441850:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5c1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f593f expref: 33 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.441859:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:1.0:1788211773.441862:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788211773.441865:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37a000, rc 0) 00000100:00100000:1.0:1788211773.442038:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:10518:x1875075637756032:12345-192.168.204.29@tcp:101:bash.0 Request processed in 17562us (17815us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788211773.442050:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 96 00000100:00100000:3.0:1788211773.446900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211773.447447:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637756160 00000100:00100000:2.0:1788211773.447459:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637756160 00000100:00100000:2.0:1788211773.447521:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:2.0:1788211773.447637:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2358:x1875075637756160:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1788211773.447656:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211773.447680:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bea9fa25/0x2afbce82f55a5c2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5946 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788211773.447711:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211773.447732:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1788211773.447737:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211773.447746:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bea9fa25/0x2afbce82f55a5c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5946 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.447765:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bea9fa25/0x2afbce82f55a5c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5946 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.447797:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80400, rc 0) 00000100:00100000:2.0:1788211773.447865:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637756160:12345-192.168.204.29@tcp:101:bash.0 Request processed in 232us (974us total) trans 0 rc 0/0 00010000:00010000:0.0:1788211773.448499:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.448511:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5c15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.448518:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5c15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.448534:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37a800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211773.448542:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5c15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.448550:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5c15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.448565:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc37ece00) 00010000:00010000:0.0:1788211773.448569:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211773.448573:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5c15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.448579:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5c15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211773.451520:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:0.0:1788211773.451685:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211773.451765:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637756288 00000100:00100000:1.0:1788211773.451775:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637756288 00000100:00100000:1.0:1788211773.451854:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:1.0:1788211773.451865:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:10518:x1875075637756288:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788211773.451884:0:8290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211773.451902:0:8290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f594d expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.451933:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bea9fa25/0x2afbce82f55a5c2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5946 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.451943:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211773.451947:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211773.451953:0:8290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 7 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.451988:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bea9fa25/0x2afbce82f55a5c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5946 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.452003:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bea9fa25/0x2afbce82f55a5c2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5946 expref: 7 pid: 6696 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211773.452019:0:8290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8290:1875075660843904:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211773.452110:0:8290:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe488b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788211773.455910:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211773.457821:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637756416 00000100:00100000:1.0:1788211773.457850:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637756416 00010000:00010000:1.0:1788211773.457909:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bea9fa25/0x2afbce82f55a5c2a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5946 expref: 8 pid: 6696 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211773.457980:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:1.0:1788211773.457993:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637756416:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211773.458013:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211773.458043:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bea9fa25/0x2afbce82f55a5c2a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5946 expref: 8 pid: 6696 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.458059:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bea9fa25/0x2afbce82f55a5c2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5946 expref: 8 pid: 6696 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.458089:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211773.458094:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211773.458102:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 8 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.458114:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 8 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.458205:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 8 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211773.458221:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1875075660844032:192.168.204.29@tcp:105: 00000100:00100000:1.0:1788211773.458338:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc15fca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788211773.460890:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1875075660844032:192.168.204.29@tcp:105: 00010000:00010000:3.0:1788211773.460915:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211773.460975:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637756416:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 2984us (5073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211773.460986:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00010000:00010000:0.0:1788211773.462456:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bea9fa25/0x2afbce82f55a5c2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5946 expref: 7 pid: 6696 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211773.462497:0:8290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8290:1875075660843904:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211773.462532:0:8290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 6 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.463505:0:8290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b200, rc 0) 00000100:00100000:0.0:1788211773.463595:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:10518:x1875075637756288:12345-192.168.204.29@tcp:101:bash.0 Request processed in 11727us (11907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211773.463608:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:1.0:1788211773.467005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211773.467347:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637756672 00000100:00100000:3.0:1788211773.467357:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637756672 00000100:00100000:3.0:1788211773.467411:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:3.0:1788211773.467422:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+33:10518:x1875075637756672:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:3.0:1788211773.467823:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:10518:x1875075637756672:12345-192.168.204.29@tcp:35:bash.0 Request processed in 402us (827us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788211773.467832:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 25 00010000:00010000:3.0:1788211773.611512:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211773.642492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211773.642680:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637756800 00000100:00100000:2.0:1788211773.642692:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637756800 00000100:00100000:2.0:1788211773.642764:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 97 00000100:00100000:2.0:1788211773.642776:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:10534:x1875075637756800:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211773.642808:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211773.642851:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5c38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5954 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.642930:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5c3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.642946:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.642959:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211773.643027:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788211773.643032:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211773.643060:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.643091:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5c38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5954 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.643138:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5c3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5954 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.643149:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:2.0:1788211773.643153:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211773.643156:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81800, rc 0) 00000100:00100000:2.0:1788211773.643285:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+35:10534:x1875075637756800:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 511us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211773.643292:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 97 00000100:00100000:1.0:1788211773.650881:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211773.651024:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637757056 00000100:00100000:3.0:1788211773.651035:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637757056 00000100:00100000:3.0:1788211773.651103:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 98 00000100:00100000:3.0:1788211773.651123:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+35:10534:x1875075637757056:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211773.651146:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211773.651313:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5c46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f595b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.651781:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.651797:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.651809:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211773.651821:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788211773.652091:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5c46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f595b expref: 38 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.652113:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f595b expref: 37 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.653079:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:3.0:1788211773.653083:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211773.653088:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063400, rc 0) 00000100:00100000:3.0:1788211773.653213:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+37:10534:x1875075637757056:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2090us (2331us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788211773.653223:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 98 00000100:00100000:1.0:1788211773.657860:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211773.657912:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211773.660389:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637757312 00000100:00100000:2.0:1788211773.660405:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637757312 00000100:00100000:2.0:1788211773.660504:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 99 00000100:00100000:2.0:1788211773.660518:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+37:10534:x1875075637757312:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211773.660551:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211773.660577:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5c5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5962 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.660700:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5c62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.660717:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5c62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.660730:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5c62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211773.660745:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788211773.660933:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5c5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5962 expref: 40 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.660957:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5c62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5962 expref: 39 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.660966:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:2.0:1788211773.660969:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788211773.660973:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80400, rc 0) 00000100:00100000:2.0:1788211773.661062:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:10534:x1875075637757312:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 546us (3213us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788211773.661070:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 99 00000100:00100000:3.0:1788211773.661705:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637757440 00000100:00100000:3.0:1788211773.661713:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637757440 00000100:00100000:3.0:1788211773.661777:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:3.0:1788211773.661787:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:2358:x1875075637757440:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211773.661801:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211773.661848:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f595b expref: 39 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.661865:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:3.0:1788211773.661869:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211773.661913:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+38:2358:x1875075637757440:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 127us (4000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211773.661921:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:1.0:1788211773.666774:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211773.666962:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637757568 00000100:00100000:3.0:1788211773.666974:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637757568 00000100:00100000:3.0:1788211773.667043:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:3.0:1788211773.667054:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637757568:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:3.0:1788211773.667112:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.667148:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 6 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.667158:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211773.667163:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788211773.667189:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.667230:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 6 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.667245:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 6 pid: 8290 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211773.667275:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe056d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1875075660844160:192.168.204.29@tcp:104: 00000100:00100000:3.0:1788211773.667375:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788211773.670265:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe056d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1875075660844160:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211773.670311:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211773.671459:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211773.671544:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637757696 00000100:00100000:2.0:1788211773.671554:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637757696 00002000:00100000:2.0:1788211773.671612:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8abfef9a8700 x1875075637757696/t0(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:324/0 lens 504/0 e 0 to 0 dl 1788211784 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788211773.671623:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abfef9a8700 with x1875075637757696 ext(0->8) 00010000:00010000:2.0:1788211773.671634:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 7 pid: 8290 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.671651:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 7 pid: 8290 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788211773.671661:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8abfef9a8700 00000100:00100000:2.0:1788211773.671699:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:2.0:1788211773.671710:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637757696:12345-192.168.204.29@tcp:4:lfs.0 00000100:00100000:2.0:1788211773.673706:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2359:x1875075637757696:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 1986us (2242us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788211773.673730:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00002000:00100000:2.0:1788211773.673743:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8abfef9a8700 x1875075637757696/t4294967302(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:324/0 lens 504/448 e 0 to 0 dl 1788211784 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788211773.673754:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abfef9a8700 with x1875075637757696 ext(0->8) 00010000:00010000:2.0:1788211773.673763:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 9 pid: 8290 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.673780:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 9 pid: 8290 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788211773.673788:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8abfef9a8700 00000100:00100000:3.0:1788211773.675916:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211773.676200:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637757824 00000100:00100000:1.0:1788211773.676212:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637757824 00010000:00010000:1.0:1788211773.676255:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 9 pid: 8290 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211773.676306:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:1.0:1788211773.676316:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2358:x1875075637757824:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211773.676332:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788211773.676352:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788211773.676355:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788211772 00002000:00010000:1.0:1788211773.676357:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788211773 00002000:00010000:1.0:1788211773.676360:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788211772 00010000:00010000:1.0:1788211773.676366:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 9 pid: 8290 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.676381:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 9 pid: 8290 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.676404:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a5c31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f594d expref: 9 pid: 8290 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.676423:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788211773.676439:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788211773.676446:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.676456:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.676492:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788211773.676622:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.676633:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.676658:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.676667:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.676674:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.676680:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211773.676692:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.676701:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.676715:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.676723:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a5c70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211773.676795:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2358:x1875075637757568:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 9741us (10031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211773.676803:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:1.0:1788211773.677157:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2358:x1875075637757824:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 840us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211773.677164:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:3.0:1788211773.680575:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211773.680680:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637758080 00000100:00100000:1.0:1788211773.680696:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637758080 00000100:00100000:1.0:1788211773.680758:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:1.0:1788211773.680771:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc64fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+38:10534:x1875075637758080:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:1.0:1788211773.680875:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5c62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5962 expref: 38 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788211773.681273:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788211773.681320:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788211773.681661:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788211773.681717:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.681732:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5c1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f593f expref: 42 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.681741:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.681793:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5c1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f593f expref: 42 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211773.681808:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5c1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f593f expref: 42 pid: 9952 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211773.681824:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1875075660844288:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211773.681908:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca4a0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788211773.685111:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1875075660844288:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211773.685151:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211773.686549:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211773.686628:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637758208 00000100:00100000:2.0:1788211773.686637:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637758208 00010000:00010000:2.0:1788211773.686675:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5c1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f593f expref: 43 pid: 9952 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211773.686715:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:2.0:1788211773.686725:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+43:2359:x1875075637758208:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211773.686740:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211773.686747:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5c1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f593f expref: 43 pid: 9952 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.686761:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5c1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f593f expref: 43 pid: 9952 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.686783:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5c1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f593f expref: 43 pid: 9952 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.686815:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:2.0:1788211773.686821:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.686841:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.686850:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.686879:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211773.686935:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:2359:x1875075637758208:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 210us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211773.686943:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 51 00010000:00010000:3.0:1788211773.687154:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.687163:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788211773.687480:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788211773.687693:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788211773.687808:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe055500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875075660844416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788211773.687928:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211773.688073:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788211773.692628:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660844416 00000100:00100000:1.0:1788211773.692644:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660844416 00000100:00100000:1.0:1788211773.692736:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788211773.692746:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875075660844416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788211773.692959:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875075660844416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 214us (5031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211773.692968:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788211773.693125:0:5847:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788211773.693132:0:5847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1788211773.693156:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac0010a1500, transno 4294967301 00000100:00100000:2.0:1788211773.693214:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe055500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875075660844416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788211773.693713:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788211773.693793:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001236d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875075660844544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788211773.693840:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211773.693863:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4780 going to sleep for 11 seconds 00000100:00080000:3.0:1788211773.694151:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211773.694209:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660844544 00000100:00100000:1.0:1788211773.694215:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660844544 00000100:00100000:1.0:1788211773.694247:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788211773.694254:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875075660844544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788211773.694423:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1875075660844544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 168us (582us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788211773.694441:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788211773.694850:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001236d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875075660844544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788211773.694907:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788211773.694952:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.694975:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.694984:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.694991:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211773.694997:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.695006:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.695027:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:2.0:1788211773.695030:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788211773.695035:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.695043:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5c77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788211773.695469:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788211773.695641:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788211773.695657:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363001489703ns, next at 364001487180ns, rc = 0 00000001:00080000:2.0:1788211773.695666:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788211773.695712:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:2.0:1788211773.695715:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788211773.695724:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5c62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5962 expref: 46 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211773.695979:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc64fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+45:10534:x1875075637758080:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 15209us (15416us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788211773.695990:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 26 00000020:00080000:2.0:1788211773.695995:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788211773.699843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211773.699918:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637758336 00000100:00100000:0.0:1788211773.699928:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637758336 00000100:00100000:0.0:1788211773.699987:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 100 00000100:00100000:0.0:1788211773.699998:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+45:10534:x1875075637758336:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788211773.700025:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211773.700049:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5c7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5969 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.700125:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5c7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5969 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.700144:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5c7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5969 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211773.700210:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:0.0:1788211773.700214:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788211773.700218:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc600, rc 0) 00000100:00100000:0.0:1788211773.700390:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+46:10534:x1875075637758336:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 282us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211773.700397:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 100 00000100:00100000:3.0:1788211773.703382:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211773.703776:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637758592 00000100:00100000:0.0:1788211773.703790:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637758592 00000100:00100000:0.0:1788211773.703878:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:0.0:1788211773.703890:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+46:10534:x1875075637758592:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1788211773.704220:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+47:10534:x1875075637758592:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 331us (852us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788211773.704229:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:1.0:1788211773.807016:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211773.807128:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637758720 00000100:00100000:3.0:1788211773.807139:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637758720 00000100:00100000:3.0:1788211773.807296:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 101 00000100:00100000:3.0:1788211773.807308:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+47:10544:x1875075637758720:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1788211773.807416:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807438:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807470:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807485:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5c8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807492:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807498:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807725:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807735:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807743:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788211773.807798:0:6717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807816:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807822:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807844:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807866:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211773.807872:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807879:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807894:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:3.0:1788211773.807897:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211773.807901:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807908:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5c85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807924:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807929:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5c8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807935:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5c8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807939:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211773.807942:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5c8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807947:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5c8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807963:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc5bbe800) 00010000:00010000:3.0:1788211773.807966:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211773.807969:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5c8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807975:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5c8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807991:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.807998:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5c93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.808004:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.808009:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211773.808012:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.808018:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5c93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.808024:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:3.0:1788211773.808026:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211773.808029:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5c93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.808035:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5c93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211773.808159:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+47:10544:x1875075637758720:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 851us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211773.808691:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 101 00000100:00100000:1.0:1788211773.858964:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211773.859157:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637758976 00000100:00100000:2.0:1788211773.859201:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637758976 00000100:00100000:2.0:1788211773.859271:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 102 00000100:00100000:2.0:1788211773.859293:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+47:10547:x1875075637758976:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211773.859322:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211773.859351:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5c9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5970 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.859469:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5ca1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.859490:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.859504:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.859522:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5ca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.859540:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.859547:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.860146:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a5caf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.860156:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a5caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.860162:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a5caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211773.860215:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788211773.861086:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861105:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5ca1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861124:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861131:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211773.861137:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861146:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861711:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:2.0:1788211773.861715:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211773.861722:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5ca1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861751:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a5ca1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861773:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861779:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861784:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861789:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211773.861792:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861799:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861808:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc9a0d400) 00010000:00010000:2.0:1788211773.861811:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211773.861814:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5ca8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.861820:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a5ca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.864146:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80400/0x2afbce82f55a5c9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5970 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.864201:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a5caf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5970 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.864229:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211773.864232:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211773.864236:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80800, rc 0) 00000100:00100000:2.0:1788211773.864343:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+49:10547:x1875075637758976:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 5050us (5390us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788211773.864356:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 102 00000100:00100000:0.0:1788211773.869962:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211773.870061:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637759104 00000100:00100000:2.0:1788211773.870072:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637759104 00000100:00100000:2.0:1788211773.870148:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 103 00000100:00100000:2.0:1788211773.870161:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+49:10547:x1875075637759104:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:2.0:1788211773.870267:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5cbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.870284:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.870296:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.870328:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.870336:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5cbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.870343:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5cbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.870349:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211773.870369:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5cbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.870377:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5cbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.870390:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211773.870393:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788211773.870397:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5cbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.870403:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a5cbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211773.870501:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+49:10547:x1875075637759104:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 342us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211773.870511:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 103 00000100:00100000:3.0:1788211773.874041:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211773.874462:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637759360 00000100:00100000:0.0:1788211773.874478:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637759360 00000100:00100000:0.0:1788211773.874567:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:0.0:1788211773.874580:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+49:10547:x1875075637759360:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1788211773.874908:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+50:10547:x1875075637759360:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 329us (877us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788211773.874917:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:0.0:1788211773.976348:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211773.976466:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637759616 00000100:00100000:3.0:1788211773.976480:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637759616 00000100:00100000:3.0:1788211773.976571:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 104 00000100:00100000:3.0:1788211773.976585:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+50:10557:x1875075637759616:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:3.0:1788211773.976618:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211773.976622:0:6717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788211773.976658:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a5c3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5954 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.976682:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:3.0:1788211773.976688:0:6717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788211773.976704:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5cc4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5977 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.976847:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ccb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.976864:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.976877:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211773.976890:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788211773.977059:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5cc4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5977 expref: 52 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.977075:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5977 expref: 51 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.977083:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:3.0:1788211773.977086:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211773.977088:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062600, rc 0) 00000100:00100000:3.0:1788211773.977718:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:10557:x1875075637759616:12345-192.168.204.29@tcp:101:bash.0 Request processed in 1131us (1382us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788211773.977728:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 104 00000100:00100000:2.0:1788211773.981337:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211773.981487:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637759872 00000100:00100000:3.0:1788211773.981501:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637759872 00000100:00100000:3.0:1788211773.981581:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 105 00000100:00100000:3.0:1788211773.981595:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:10557:x1875075637759872:12345-192.168.204.29@tcp:36:bash.0 00010000:00010000:3.0:1788211773.981677:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788211773.981710:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ccb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5977 expref: 51 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.981736:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80800/0x2afbce82f55a5caf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5970 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.981751:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:3.0:1788211773.981757:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788211773.982033:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5cd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.982067:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.982078:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788211773.982151:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1788211773.982211:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f8e5246 reply state 00000000cac9da4f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211773.982222:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788211773.982648:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10557:x1875075637759872:12345-192.168.204.29@tcp:36:bash.0 Request processed in 1054us (1323us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788211773.982658:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 105 00000020:00080000:3.0:1788211773.982664:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788211773.985862:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.985879:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5cd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.985886:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.985892:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211773.985897:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.985904:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5cd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.985939:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211773.985942:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211773.985946:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5cd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211773.985953:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5cd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211773.989906:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211773.989978:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637760000 00000100:00100000:3.0:1788211773.989988:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637760000 00000100:00100000:3.0:1788211773.990051:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 106 00000100:00100000:3.0:1788211773.990061:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:10557:x1875075637760000:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:3.0:1788211773.990087:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211773.990118:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5ce0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f597e expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.990399:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5ce7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.990414:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.990425:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211773.990465:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788211773.990470:0:9952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211773.990489:0:9952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.990518:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5ce0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f597e expref: 53 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.990599:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f597e expref: 52 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211773.990608:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:3.0:1788211773.990612:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211773.990615:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063600, rc 0) 00000100:00100000:3.0:1788211773.990734:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10557:x1875075637760000:12345-192.168.204.29@tcp:101:bash.0 Request processed in 673us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211773.990741:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 106 00000100:00100000:0.0:1788211774.002678:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211774.003146:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637760256 00000100:00100000:1.0:1788211774.003159:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637760256 00000100:00100000:1.0:1788211774.003558:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:1.0:1788211774.003570:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:10557:x1875075637760256:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:1.0:1788211774.003920:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+53:10557:x1875075637760256:12345-192.168.204.29@tcp:35:bash.0 Request processed in 351us (5821us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788211774.003928:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00080000:3.0:1788211774.008998:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211774.092437:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.092804:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637760384 00000100:00100000:2.0:1788211774.092814:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637760384 00000100:00100000:2.0:1788211774.092999:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 107 00000100:00100000:2.0:1788211774.093010:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+53:10563:x1875075637760384:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211774.093036:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211774.093058:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5cee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5985 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.093145:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5cf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.093161:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.093199:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211774.093442:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788211774.093447:0:6717:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211774.093476:0:6717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.093516:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5cee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5985 expref: 55 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.093647:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5985 expref: 54 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.093657:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:2.0:1788211774.093660:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211774.093663:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7c00, rc 0) 00000100:00100000:2.0:1788211774.093850:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:10563:x1875075637760384:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 840us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211774.093858:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 107 00000100:00100000:0.0:1788211774.113795:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211774.113967:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637760512 00000100:00100000:3.0:1788211774.113976:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637760512 00000100:00100000:3.0:1788211774.114037:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 108 00000100:00100000:3.0:1788211774.114047:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:10563:x1875075637760512:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211774.114077:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211774.114098:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5cfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f598c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.114670:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5d03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.114763:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5d03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.114776:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5d03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.114793:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5d0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.114799:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.114805:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.114977:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.114986:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.114994:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211774.115038:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788211774.115043:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211774.116364:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116388:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116422:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5d03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116429:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5d03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116438:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5d03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116444:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211774.116448:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5d03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116456:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5d03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116470:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:3.0:1788211774.116473:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211774.116476:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5d03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116483:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5d03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116501:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116507:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5d0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116513:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5d0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116760:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063a00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211774.116764:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5d0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116771:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5d0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116781:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc5bbe800) 00010000:00010000:3.0:1788211774.116784:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211774.116787:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5d0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.116793:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5d0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.117128:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5cfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f598c expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.118096:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f598c expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.118116:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:3.0:1788211774.118120:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211774.118123:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062000, rc 0) 00000100:00100000:3.0:1788211774.118325:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:10563:x1875075637760512:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4277us (4538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211774.118335:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 108 00000100:00100000:0.0:1788211774.126842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.126996:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637760768 00000100:00100000:2.0:1788211774.127007:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637760768 00000100:00100000:2.0:1788211774.127076:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 109 00000100:00100000:2.0:1788211774.127087:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:10563:x1875075637760768:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211774.127117:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211774.127139:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5993 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.127303:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.127320:0:9952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5ce7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f597e expref: 56 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.127328:0:9952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f598c expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.127344:0:9952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.127379:0:9952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f598c expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.127392:0:9952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f598c expref: 56 pid: 5845 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211774.127405:0:9952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001235f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9952:1875075660844672:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211774.127508:0:9952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f597e expref: 56 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.127518:0:9952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5ce7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f597e expref: 56 pid: 9952 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211774.127527:0:9952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001237100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9952:1875075660844800:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211774.130353:0:9952:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc5521900 going to sleep for 11 seconds 00000100:00100000:1.0:1788211774.139097:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211774.140693:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637760896 00000100:00100000:3.0:1788211774.140721:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637760896 00010000:00010000:3.0:1788211774.140769:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f598c expref: 57 pid: 5845 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211774.140821:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:3.0:1788211774.140831:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:2359:x1875075637760896:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211774.140846:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211774.140853:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f598c expref: 57 pid: 5845 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.140867:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f598c expref: 57 pid: 5845 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.140890:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:3.0:1788211774.140896:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.140905:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.140913:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211774.140978:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:2359:x1875075637760896:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 148us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211774.140987:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 52 00010000:00010000:2.0:1788211774.144206:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5d11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f598c expref: 56 pid: 5845 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211774.144246:0:9952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001235f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9952:1875075660844672:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211774.144261:0:9952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001237100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9952:1875075660844800:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211774.144450:0:9952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211774.149923:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211774.150071:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637761024 00000100:00100000:3.0:1788211774.150084:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637761024 00010000:00010000:3.0:1788211774.150155:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5ce7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f597e expref: 56 pid: 9952 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211774.150516:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:3.0:1788211774.150538:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:2361:x1875075637761024:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211774.150554:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211774.150562:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5ce7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f597e expref: 56 pid: 9952 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.150576:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f597e expref: 56 pid: 9952 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.150602:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5ce7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f597e expref: 56 pid: 9952 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.150622:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:3.0:1788211774.150628:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.150638:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.150645:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.150719:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211774.150788:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:2361:x1875075637761024:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 262us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211774.150796:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00010000:00010000:2.0:1788211774.153453:0:9952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.153473:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211774.153500:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788211774.153750:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5993 expref: 56 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.153769:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5993 expref: 55 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.153778:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211774.153781:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788211774.153784:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6200, rc 0) 00000100:00100000:2.0:1788211774.153998:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:10563:x1875075637760768:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 26910us (27173us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788211774.154009:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 109 00000100:00100000:1.0:1788211774.159459:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.159583:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637761280 00000100:00100000:2.0:1788211774.159594:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637761280 00000100:00100000:2.0:1788211774.159661:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:2.0:1788211774.159672:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:10563:x1875075637761280:12345-192.168.204.29@tcp:103:lfs.0 00010000:00010000:2.0:1788211774.159689:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211774.159716:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5c7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5969 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.159754:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211774.159759:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211774.159820:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:10563:x1875075637761280:12345-192.168.204.29@tcp:103:lfs.0 Request processed in 150us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211774.159883:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:1.0:1788211774.163799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.163968:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637761408 00000100:00100000:2.0:1788211774.163978:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637761408 00000100:00100000:2.0:1788211774.164076:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 110 00000100:00100000:2.0:1788211774.164088:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:10563:x1875075637761408:12345-192.168.204.29@tcp:58:lfs.0 00010000:00010000:2.0:1788211774.164263:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a5d2d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.164288:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a5d2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.164300:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a5d2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788211774.164502:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788211774.164708:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:10563:x1875075637761408:12345-192.168.204.29@tcp:58:lfs.0 Request processed in 621us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211774.164715:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 110 00000100:00100000:0.0:1788211774.170693:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211774.171585:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637761536 00000100:00100000:1.0:1788211774.171596:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637761536 00000100:00100000:1.0:1788211774.171658:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 111 00000100:00100000:1.0:1788211774.171669:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:10563:x1875075637761536:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1788211774.171689:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211774.171711:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5d34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f599a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.171774:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a5d2d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.171784:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5d34 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f599a expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.171820:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a5d2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.171945:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5d34 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f599a expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.171963:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:1.0:1788211774.171967:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788211774.171972:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5d34 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f599a expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.171980:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37a800, rc 0) 00000100:00100000:1.0:1788211774.173824:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:10563:x1875075637761536:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2143us (3127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211774.173848:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 111 00000040:00080000:3.0:1788211774.247889:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788211774.247915:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788211774.247976:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788211774.247983:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788211774.248151:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8cb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1875075660844928:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788211774.250960:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc59a96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211774.259138:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.259560:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637761664 00000100:00100000:2.0:1788211774.259570:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637761664 00000100:00100000:2.0:1788211774.259632:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 112 00000100:00100000:2.0:1788211774.259643:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10564:x1875075637761664:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788211774.259678:0:9952:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788211774.259810:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10564:x1875075637761664:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 168us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211774.259819:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 112 00000100:00100000:3.0:1788211774.261137:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8cb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1875075660844928:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788211774.269484:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211774.269643:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637761792 00000100:00100000:1.0:1788211774.269653:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637761792 00000100:00100000:1.0:1788211774.269716:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 113 00000100:00100000:1.0:1788211774.269726:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:10564:x1875075637761792:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788211774.269823:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5d3b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.269850:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5d3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.269860:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5d3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.269895:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5d42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.269903:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5d42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.269909:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5d42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.269936:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5d49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.269943:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.269949:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211774.269994:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788211774.269999:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788211774.270013:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270026:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5d3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270032:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5d3b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270039:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5d3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270065:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37aa00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211774.270069:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5d3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270077:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5d3b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270088:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfc9a0db00) 00010000:00010000:1.0:1788211774.270091:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211774.270096:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5d3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270101:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5d3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270124:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5d42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270129:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5d42 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270135:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5d42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270140:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ba00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211774.270142:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5d42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270149:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5d42 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270211:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8abfc37ec800) 00010000:00010000:1.0:1788211774.270214:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211774.270217:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5d42 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270222:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5d42 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270239:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270245:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5d49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270251:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270256:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37a000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211774.270259:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270264:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5d49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270281:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:1.0:1788211774.270284:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211774.270287:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5d49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.270292:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5d49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211774.270390:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:10564:x1875075637761792:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 Request processed in 664us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211774.270398:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 113 00000100:00100000:1.0:1788211774.276550:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.277217:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637762048 00000100:00100000:2.0:1788211774.277230:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637762048 00000100:00100000:2.0:1788211774.277307:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 114 00000100:00100000:2.0:1788211774.277320:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:10564:x1875075637762048:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211774.277345:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211774.277371:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59a1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.277496:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.277528:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.277541:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211774.277553:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788211774.277669:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.277677:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.277684:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.277690:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211774.277710:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.277719:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.277731:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211774.277735:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788211774.277739:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.277747:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.277795:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d50 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59a1 expref: 57 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.277805:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfc9a0db00) 00010000:00010000:2.0:1788211774.277808:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788211774.277812:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59a1 expref: 57 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.277822:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7000, rc 0) 00000100:00100000:2.0:1788211774.277902:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10564:x1875075637762048:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 585us (1367us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788211774.277911:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 114 00000100:00100000:0.0:1788211774.296627:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211774.296818:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637762176 00000100:00100000:3.0:1788211774.296829:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637762176 00000100:00100000:3.0:1788211774.296938:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 115 00000100:00100000:3.0:1788211774.296949:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10564:x1875075637762176:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788211774.296995:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788211774.297128:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10564:x1875075637762176:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 181us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211774.297136:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 115 00000100:00100000:3.0:1788211774.306363:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.306723:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637762432 00000100:00100000:2.0:1788211774.306734:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637762432 00000100:00100000:2.0:1788211774.306803:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:2.0:1788211774.306816:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10564:x1875075637762432:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211774.306857:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211774.306860:0:6717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788211774.306889:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5cf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5985 expref: 56 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.306909:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:2.0:1788211774.306915:0:6717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211774.306927:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d65 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59a8 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788211774.307520:0:6717:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788211774.307781:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.307797:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.307808:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.307869:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59a8 expref: 58 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.307886:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59a8 expref: 57 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.307894:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfc9a0d400) 00010000:00010000:2.0:1788211774.307897:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211774.307911:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7600, rc 0) 00000100:00100000:2.0:1788211774.307985:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:10564:x1875075637762432:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1170us (1632us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788211774.307995:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:0.0:1788211774.326456:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.326551:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637762688 00000100:00100000:2.0:1788211774.326561:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637762688 00000100:00100000:2.0:1788211774.326629:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 117 00000100:00100000:2.0:1788211774.326641:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:10564:x1875075637762688:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788211774.326709:0:9952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211774.326739:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5d6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59a8 expref: 57 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.326760:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfc9a0d400) 00010000:00010000:2.0:1788211774.326772:0:9952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211774.326795:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d7a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.326811:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.326820:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.326847:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5d81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xcb4d983d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.326854:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5d81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb4d983d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.326861:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5d81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb4d983d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.326955:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.326962:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d7a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.326968:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.326974:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211774.326977:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.326984:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d7a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.326993:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:2.0:1788211774.326995:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211774.326999:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.327004:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5d7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.327012:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5d81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb4d983d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.327018:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5d81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb4d983d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.327022:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5d81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb4d983d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.327034:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211774.327037:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5d81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb4d983d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.327042:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5d81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcb4d983d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.327049:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xcb4d983d (ffff8abfc9a0dd00) 00010000:00010000:2.0:1788211774.327052:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211774.327054:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5d81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcb4d983d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.327060:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5d81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcb4d983d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211774.327161:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10564:x1875075637762688:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 522us (716us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788211774.327224:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 117 00000100:00100000:0.0:1788211774.330535:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.330615:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637762816 00000100:00100000:2.0:1788211774.330626:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637762816 00000100:00100000:2.0:1788211774.330696:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:2.0:1788211774.330707:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:10564:x1875075637762816:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211774.330728:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211774.330751:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a5d88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59af expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.330790:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5d8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.330849:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.330862:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.330964:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a5d88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59af expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.330982:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59af expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.330991:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfc9a0da00) 00010000:00010000:2.0:1788211774.330994:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788211774.330998:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6a00, rc 0) 00000100:00100000:2.0:1788211774.331065:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:10564:x1875075637762816:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 359us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211774.331073:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:0.0:1788211774.341687:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211774.341968:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637763072 00000100:00100000:3.0:1788211774.341979:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637763072 00000100:00100000:3.0:1788211774.342042:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 119 00000100:00100000:3.0:1788211774.342052:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:10564:x1875075637763072:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788211774.342211:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.342229:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.342240:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788211774.342563:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:3.0:1788211774.342674:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002392f6f8 reply state 000000006d252100 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211774.342685:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788211774.342805:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:10564:x1875075637763072:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 752us (1126us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788211774.342813:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 119 00010000:00010000:3.0:1788211774.351797:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.351816:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.351824:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.351841:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211774.351846:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.351853:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.351870:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfc9a0da00) 00010000:00010000:3.0:1788211774.351874:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788211774.351878:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.351884:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211774.360424:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211774.360514:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637763200 00000100:00100000:3.0:1788211774.360529:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637763200 00000100:00100000:3.0:1788211774.360591:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:3.0:1788211774.360601:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+58:10564:x1875075637763200:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788211774.360625:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211774.360646:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59b6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.360711:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59b6 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.360726:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59b6 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.360748:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfc9a0da00) 00010000:00010000:3.0:1788211774.360751:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788211774.360755:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063600, rc 0) 00000100:00100000:3.0:1788211774.360820:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:10564:x1875075637763200:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 219us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211774.360837:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:0.0:1788211774.367341:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.367460:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637763328 00000100:00100000:2.0:1788211774.367473:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637763328 00000100:00100000:2.0:1788211774.367569:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:2.0:1788211774.367582:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637763328:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788211774.368011:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2359:x1875075637763328:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 431us (682us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788211774.368020:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00080000:1.0:1788211774.368110:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788211774.372421:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211774.372544:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637763584 00000100:00100000:1.0:1788211774.372554:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637763584 00000100:00100000:1.0:1788211774.372621:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:1.0:1788211774.372635:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:10564:x1875075637763584:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788211774.372915:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:10564:x1875075637763584:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 282us (504us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788211774.372923:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:3.0:1788211774.381505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211774.389738:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637763840 00000100:00100000:1.0:1788211774.389757:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637763840 00000100:00100000:1.0:1788211774.389838:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:1.0:1788211774.389850:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:10564:x1875075637763840:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788211774.389978:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:10564:x1875075637763840:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 130us (8483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211774.389985:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:0.0:1788211774.396842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.396970:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637763968 00000100:00100000:2.0:1788211774.396994:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637763968 00000100:00100000:2.0:1788211774.400212:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 122 00000100:00100000:2.0:1788211774.400242:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:10564:x1875075637763968:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211774.400263:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211774.400286:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a5da4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59bd expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.400366:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.400392:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.400404:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211774.400443:0:9952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211774.400465:0:9952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.400490:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a5da4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59bd expref: 62 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.400508:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59bd expref: 61 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.400516:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfc9a0da00) 00010000:00010000:2.0:1788211774.400519:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788211774.400522:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7c00, rc 0) 00000100:00100000:2.0:1788211774.400599:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:10564:x1875075637763968:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 369us (3777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211774.400621:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 122 00000100:00100000:0.0:1788211774.410444:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211774.410588:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637764096 00000100:00100000:1.0:1788211774.410598:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637764096 00000100:00100000:1.0:1788211774.410654:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:1.0:1788211774.410664:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2359:x1875075637764096:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788211774.410681:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211774.410724:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000decfef02/0x2afbce82f55a5db2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59c4 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788211774.410756:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95f23d, blocks: 0x1 00010000:00010000:1.0:1788211774.410781:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1788211774.410785:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211774.410796:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000decfef02/0x2afbce82f55a5db2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59c4 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.410817:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000decfef02/0x2afbce82f55a5db2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59c4 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.410830:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37a000, rc 0) 00000100:00100000:1.0:1788211774.410896:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:2359:x1875075637764096:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 233us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211774.410903:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:0.0:1788211774.414393:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.415152:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637764352 00000100:00100000:2.0:1788211774.415162:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637764352 00000100:00100000:2.0:1788211774.415267:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 123 00000100:00100000:2.0:1788211774.415279:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:10564:x1875075637764352:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788211774.415410:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:10564:x1875075637764352:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 132us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211774.415417:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 123 00000100:00100000:2.0:1788211774.426159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211774.428651:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637764480 00000100:00100000:1.0:1788211774.428670:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637764480 00000100:00100000:1.0:1788211774.428873:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:1.0:1788211774.428885:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff7080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:10564:x1875075637764480:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788211774.428904:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211774.428925:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59cb expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.428956:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000decfef02/0x2afbce82f55a5db2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59c4 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.428985:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211774.428990:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211774.428996:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59cb expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.429036:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000decfef02/0x2afbce82f55a5db2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59c4 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.429051:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000decfef02/0x2afbce82f55a5db2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59c4 expref: 11 pid: 6696 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211774.429079:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe031880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875075660845056:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211774.429331:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca4a0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788211774.441767:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211774.441884:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe031880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875075660845056:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211774.441922:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59cb expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.441945:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37ba00, rc 0) 00000100:00100000:1.0:1788211774.442013:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff7080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+11:10564:x1875075637764480:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 13129us (15865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211774.442023:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:3.0:1788211774.442700:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637764608 00000100:00100000:3.0:1788211774.442709:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637764608 00010000:00010000:3.0:1788211774.442744:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000decfef02/0x2afbce82f55a5db2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59c4 expref: 11 pid: 6696 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211774.442805:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:3.0:1788211774.442815:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+11:2358:x1875075637764608:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211774.442829:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211774.442854:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000decfef02/0x2afbce82f55a5db2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59c4 expref: 11 pid: 6696 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.442867:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000decfef02/0x2afbce82f55a5db2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59c4 expref: 11 pid: 6696 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.442892:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000decfef02/0x2afbce82f55a5db2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59c4 expref: 11 pid: 6696 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.442907:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211774.442912:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211774.442920:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59cb expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.442931:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59cb expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.442967:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59cb expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211774.442982:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1875075660845184:192.168.204.29@tcp:105: 00000100:00100000:3.0:1788211774.443061:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc63826c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211774.455585:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1875075660845184:192.168.204.29@tcp:105: 00010000:00010000:3.0:1788211774.455612:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211774.455675:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:2358:x1875075637764608:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 12860us (13918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211774.455687:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:0.0:1788211774.468288:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211774.468379:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637764736 00000100:00100000:3.0:1788211774.468391:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637764736 00002000:00100000:3.0:1788211774.468453:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8ac001242300 x1875075637764736/t0(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:325/0 lens 504/0 e 0 to 0 dl 1788211785 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211774.468467:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac001242300 with x1875075637764736 ext(0->12) 00002000:00010000:3.0:1788211774.468473:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ac001242300 00000100:00100000:3.0:1788211774.468510:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1788211774.468529:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:2360:x1875075637764736:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788211774.469017:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+12:2360:x1875075637764736:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 Request processed in 496us (750us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788211774.469026:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00002000:00100000:3.0:1788211774.469034:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8ac001242300 x1875075637764736/t4294967308(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:325/0 lens 504/448 e 0 to 0 dl 1788211785 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211774.469043:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac001242300 with x1875075637764736 ext(0->12) 00002000:00010000:3.0:1788211774.469047:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ac001242300 00000100:00100000:2.0:1788211774.471411:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211774.471729:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637764864 00000100:00100000:3.0:1788211774.471740:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637764864 00000100:00100000:3.0:1788211774.471859:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 124 00000100:00100000:3.0:1788211774.471871:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:10564:x1875075637764864:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788211774.503249:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967391 is committed 00000020:00080000:0.0:1788211774.503283:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1788211774.503306:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788211774.503324:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788211774.503366:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788211774.503381:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8abffe2e4c00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788211774.503386:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abffe3d8f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8abfefab5300 00000020:00080000:0.0:1788211774.503389:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abffe3d8500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ac001258000 00000020:00080000:0.0:1788211774.503400:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8abffe2e4a80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788211774.503402:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abfd87f1400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8abffe2e4540 00000020:00080000:0.0:1788211774.503421:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abfd87f1c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8abfc58d3000 00000100:00100000:0.0:1788211774.503625:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660845312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788211774.503688:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211774.503754:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788211774.503762:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660845440:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788211774.503795:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211774.503836:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660845312 00000100:00100000:3.0:1788211774.503844:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660845312 00000020:00080000:1.0:1788211774.503844:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:0.0:1788211774.503845:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660845440 00000100:00100000:2.0:1788211774.503846:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:10564:x1875075637764864:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 Request processed in 31972us (32439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211774.503853:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660845440 00000100:00100000:3.0:1788211774.503904:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788211774.503915:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660845312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788211774.503943:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00000100:00100000:2.0:1788211774.503962:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 124 00000100:00100000:0.0:1788211774.503977:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788211774.503989:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660845440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788211774.504007:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1788211774.504039:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788211774.504045:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a95f23c, atime: 0x6a95f23d, ctime: 0x6a95f23c, blocks: 0x1 00010000:00010000:0.0:1788211774.504057:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e526d/0x2afbce82f55a5dc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.504068:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce41081a/0x2afbce82f55a5b82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f592a expref: 11 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788211774.504069:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1788211774.504071:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1788211774.504080:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211774.504090:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00000100:00080000:1.0:1788211774.504092:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788211774.504093:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e526d/0x2afbce82f55a5dc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.504116:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788211774.504122:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.504127:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66e526d/0x2afbce82f55a5dc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.504142:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e66e526d/0x2afbce82f55a5dc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.504154:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce41081a/0x2afbce82f55a5b82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f592a expref: 11 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.504195:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66e526d/0x2afbce82f55a5dc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.504205:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce41081a/0x2afbce82f55a5b82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f592a expref: 11 pid: 8290 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211774.504220:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1875075660845568:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211774.504225:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788211774.504275:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aaa80 going to sleep for 11 seconds 00010000:00010000:2.0:1788211774.504509:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211774.504517:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66e526d/0x2afbce82f55a5dc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.504525:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8ccc00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211774.504530:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e526d/0x2afbce82f55a5dc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.504539:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66e526d/0x2afbce82f55a5dc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.504560:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66e526d/0x2afbce82f55a5dc0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.504576:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66e526d/0x2afbce82f55a5dc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.504595:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211774.504596:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211774.504598:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211774.505404:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660845440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1413us (1603us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788211774.505414:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1788211774.506027:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac001242680/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788211774.506037:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660845440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788211774.506772:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211774.506950:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637764992 00000100:00100000:0.0:1788211774.506959:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637764992 00000100:00100000:0.0:1788211774.507002:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:0.0:1788211774.507011:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+12:2361:x1875075637764992:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788211774.507981:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1875075660845568:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211774.508021:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211774.508780:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.508843:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637765120 00000100:00100000:2.0:1788211774.508850:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637765120 00010000:00010000:2.0:1788211774.508881:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce41081a/0x2afbce82f55a5b82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f592a expref: 13 pid: 8290 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211774.508921:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:2.0:1788211774.508931:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:2358:x1875075637765120:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211774.508946:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211774.508953:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce41081a/0x2afbce82f55a5b82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f592a expref: 13 pid: 8290 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.509047:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce41081a/0x2afbce82f55a5b82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f592a expref: 13 pid: 8290 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.509071:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce41081a/0x2afbce82f55a5b82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f592a expref: 13 pid: 8290 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.509811:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788211774.509819:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788211774.509826:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.509839:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.509872:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211774.509934:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+12:2358:x1875075637765120:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1001us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211774.510019:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 55 00010000:00010000:2.0:1788211774.510055:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.510065:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.510076:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.510085:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.510496:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211774.510713:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211774.510720:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.510729:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211774.510734:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.510743:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.510759:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.510766:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a5dc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.510790:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211774.510793:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211774.510795:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211774.511709:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660845312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7793us (8016us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788211774.511719:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1788211774.511780:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac001241500/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788211774.511851:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660845312:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788211774.541029:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1788211774.541050:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1788211774.541059:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1788211774.542580:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637764992:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 Request processed in 35559us (35800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211774.542603:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:0.0:1788211774.547678:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211774.547869:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637765376 00000100:00100000:2.0:1788211774.547885:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637765376 00000100:00100000:2.0:1788211774.548001:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 125 00000100:00100000:2.0:1788211774.548015:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:10564:x1875075637765376:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788211774.548108:0:9952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211774.548143:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5dab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59bd expref: 15 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.548228:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfc9a0da00) 00010000:00010000:2.0:1788211774.548233:0:9952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211774.548272:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5dce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.548286:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5dce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.548296:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5dce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788211774.548592:0:9952:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066c95e46 reply state 00000000ff6b9b00 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5dce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211774.548603:0:9952:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788211774.548725:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:10564:x1875075637765376:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 712us (1058us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788211774.548734:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 125 00000100:00100000:1.0:1788211774.553254:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:2.0:1788211774.553369:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5dce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.553383:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5dce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.553408:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5dce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.553416:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211774.553421:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5dce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.553430:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5dce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.553455:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfc9a0da00) 00010000:00010000:2.0:1788211774.553459:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211774.553467:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5dce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.553474:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5dce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211774.553655:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637765504 00000100:00100000:0.0:1788211774.553665:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637765504 00000100:00100000:0.0:1788211774.553713:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:0.0:1788211774.553723:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637765504:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788211774.554048:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788211774.554052:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788211773 00002000:00010000:0.0:1788211774.554055:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788211773 00002000:00010000:0.0:1788211774.554057:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788211773 -> 1788211773 00002000:00010000:0.0:1788211774.554059:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788211774.554196:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2361:x1875075637765504:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 473us (951us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788211774.554210:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:2.0:1788211774.556715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211774.557083:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637765760 00000100:00100000:1.0:1788211774.557092:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637765760 00000100:00100000:1.0:1788211774.557235:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 126 00000100:00100000:1.0:1788211774.557247:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:10564:x1875075637765760:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788211774.557337:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.557355:0:6717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5d8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59af expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.557365:0:6717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.557401:0:6717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59af expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.557417:0:6717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5d8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59af expref: 15 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211774.557432:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660845696:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211774.557561:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcb07e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788211774.561774:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211774.561861:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637765888 00000100:00100000:3.0:1788211774.561875:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637765888 00010000:00010000:3.0:1788211774.561926:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5d8f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59af expref: 16 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211774.561975:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:3.0:1788211774.561986:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:2358:x1875075637765888:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211774.562005:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211774.562013:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5d8f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59af expref: 16 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.562027:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5d8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59af expref: 16 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.562052:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfc9a0da00) 00010000:00010000:3.0:1788211774.562057:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.562069:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.562079:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.562129:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211774.562241:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:2358:x1875075637765888:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 255us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211774.562249:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 56 00010000:00010000:1.0:1788211774.563808:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5d8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59af expref: 15 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211774.563880:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660845696:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211774.563923:0:6717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.563934:0:6717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.563941:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.563978:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.563987:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.563995:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.564002:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211774.564008:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.564017:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.564034:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfc9a0da00) 00010000:00010000:1.0:1788211774.564038:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788211774.564043:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.564049:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211774.564239:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:10564:x1875075637765760:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 Request processed in 6994us (7534us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788211774.564249:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 126 00000100:00100000:2.0:1788211774.566994:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211774.567085:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637766016 00000100:00100000:3.0:1788211774.567095:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637766016 00000100:00100000:3.0:1788211774.567286:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:3.0:1788211774.567300:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2360:x1875075637766016:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788211774.567362:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.567383:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59cb expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.567393:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211774.567399:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788211774.567404:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.567450:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59cb expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.567469:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59cb expref: 7 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211774.567485:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1875075660845824:192.168.204.29@tcp:104: 00000100:00100000:3.0:1788211774.567598:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211774.573701:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211774.573775:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637766144 00000100:00100000:0.0:1788211774.573785:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637766144 00010000:00010000:0.0:1788211774.573884:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59cb expref: 8 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211774.573977:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:0.0:1788211774.573988:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637766144:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211774.574005:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211774.574032:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59cb expref: 8 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.574046:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59cb expref: 8 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.574070:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788211774.574075:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788211774.574081:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.574091:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.574122:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211774.574198:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637766144:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 212us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211774.574221:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 57 00010000:00010000:3.0:1788211774.574955:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a5db9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59cb expref: 7 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211774.574978:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1875075660845824:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211774.575002:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.575015:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.575022:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.575052:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.575060:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.575071:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.575078:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211774.575082:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.575122:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.575137:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.575145:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f8f0436/0x2afbce82f55a5ddc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211774.575237:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637766016:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 Request processed in 7939us (8250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211774.575246:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:2.0:1788211774.578069:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211774.578157:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637766400 00000100:00100000:3.0:1788211774.578190:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637766400 00000100:00100000:3.0:1788211774.578244:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 127 00000100:00100000:3.0:1788211774.578255:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:10564:x1875075637766400:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788211774.578351:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5de3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.578368:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5de3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.578379:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5de3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.578636:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.578661:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59b6 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.578669:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.578709:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59b6 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211774.578723:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59b6 expref: 15 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211774.578743:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef888700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660845952:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211774.579439:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211774.601579:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef888700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660845952:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211774.601611:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211774.602429:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211774.602530:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637766528 00000100:00100000:0.0:1788211774.602540:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637766528 00010000:00010000:0.0:1788211774.602581:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59b6 expref: 16 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211774.602626:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 58 00000100:00100000:0.0:1788211774.602636:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:2359:x1875075637766528:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211774.602652:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211774.603576:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59b6 expref: 16 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.603597:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59b6 expref: 16 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.603626:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5d9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59b6 expref: 16 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.603645:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfc9a0da00) 00010000:00010000:0.0:1788211774.603651:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.603660:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.603668:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.604154:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211774.604266:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:2359:x1875075637766528:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1629us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211774.604277:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 58 00010000:00010000:2.0:1788211774.605364:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.605380:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788211774.605713:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788211774.605877:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788211774.605931:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788211774.606038:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1875075660846080:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788211774.606141:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211774.606330:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc63120c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211774.606379:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660846080 00000100:00100000:1.0:1788211774.606388:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660846080 00000100:00100000:1.0:1788211774.606446:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788211774.606457:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875075660846080:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788211774.606679:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875075660846080:12345-0@lo:1000:mdt00_002.0 Request processed in 223us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211774.606686:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788211774.606744:0:5845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788211774.606750:0:5845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1788211774.606773:0:5845:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ac001241500 x1875075660845312/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788211790 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211774.606786:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1875075660846080:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788211774.607483:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788211774.607631:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1875075660846208:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788211774.607675:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211774.607747:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788211774.607785:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660846208 00000100:00100000:0.0:1788211774.607793:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660846208 00000100:00100000:0.0:1788211774.607877:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788211774.607888:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1875075660846208:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788211774.608107:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5845:x1875075660846208:12345-0@lo:1000:mdt00_002.0 Request processed in 210us (420us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788211774.608115:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788211774.608217:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1875075660846208:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788211774.608256:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608266:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608273:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608280:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211774.608286:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608305:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608321:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfc9a0da00) 00010000:00010000:2.0:1788211774.608324:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788211774.608329:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608335:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5dea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608371:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a5d2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608377:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a5d2d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608383:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a5d2d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608388:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211774.608391:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a5d2d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608396:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a5d2d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608405:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211774.608407:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788211774.608417:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5d34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f599a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608442:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5d34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f599a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608452:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5d34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f599a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.608482:0:5845:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5d34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f599a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211774.608495:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660846336:192.168.204.29@tcp:105: 00000100:00100000:2.0:1788211774.608791:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788211774.613776:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211774.613890:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660846336:192.168.204.29@tcp:105: 00010000:00010000:1.0:1788211774.613921:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a5d2d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.613933:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a5d2d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.613968:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5df1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.613999:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5df1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614010:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5df1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614020:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5df1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614025:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5df1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614031:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5df1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614038:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211774.614041:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5df1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614048:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5df1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614060:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:1.0:1788211774.614063:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211774.614067:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5df1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614072:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5df1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614082:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5de3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614093:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5de3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614110:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5de3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614116:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211774.614119:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5de3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614125:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5de3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614134:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:1.0:1788211774.614136:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788211774.614139:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5de3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.614143:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5de3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211774.614319:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637766656 00000100:00100000:0.0:1788211774.614327:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637766656 00000100:00100000:0.0:1788211774.614376:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:0.0:1788211774.614386:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:10563:x1875075637766656:12345-192.168.204.29@tcp:49:lfs.0 00000100:00100000:0.0:1788211774.614526:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:10563:x1875075637766656:12345-192.168.204.29@tcp:49:lfs.0 Request processed in 141us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211774.614533:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:1.0:1788211774.615453:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:10564:x1875075637766400:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 37195us (37388us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788211774.615463:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 127 00000020:00080000:1.0:1788211774.615467:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788211774.615757:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788211774.615762:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788211774.616460:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788211774.616475:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788211774.622013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211774.622154:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637766912 00000100:00100000:0.0:1788211774.622199:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637766912 00000100:00100000:0.0:1788211774.622263:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:0.0:1788211774.622275:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc64fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:10564:x1875075637766912:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788211774.623039:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788211774.623161:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788211774.623247:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5df8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.623265:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5df8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.623276:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5df8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.623293:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5df8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.623300:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5df8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.623306:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5df8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.623324:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788211774.623436:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc64fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:10564:x1875075637766912:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 1161us (1429us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788211774.623446:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 32 00000020:00080000:0.0:1788211774.623452:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788211774.623580:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1788211774.623787:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788211774.623795:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5df8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.623804:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788211774.623816:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5df8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.623824:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5df8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.623840:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:1.0:1788211774.623844:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788211774.623848:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5df8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.623855:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a5df8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.623873:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211774.623875:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211774.623877:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211774.624763:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637767168 00000100:00100000:0.0:1788211774.624776:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637767168 00000100:00100000:0.0:1788211774.624844:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 128 00000100:00100000:0.0:1788211774.624854:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:10563:x1875075637767168:12345-192.168.204.29@tcp:58:lfs.0 00000040:00080000:0.0:1788211774.625138:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788211774.625562:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:10563:x1875075637767168:12345-192.168.204.29@tcp:58:lfs.0 Request processed in 706us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211774.625572:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 128 00010000:00010000:2.0:1788211774.629776:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211774.647085:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211774.647315:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637767296 00000100:00100000:1.0:1788211774.647327:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637767296 00000100:00100000:1.0:1788211774.647411:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 129 00000100:00100000:1.0:1788211774.647424:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:10566:x1875075637767296:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1788211774.647462:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211774.647495:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59d2 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.647578:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.647599:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.647611:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.647645:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.647652:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.647658:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.647986:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5e14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.647998:0:6717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5993 expref: 21 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.648006:0:6717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5e14 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.648036:0:6717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5993 expref: 21 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211774.648051:0:6717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5993 expref: 21 pid: 9952 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211774.648065:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660846464:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211774.648188:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcb07e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788211774.651447:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211774.651550:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660846464:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211774.651579:0:6717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5e14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211774.651719:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637767552 00000100:00100000:0.0:1788211774.651726:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637767552 00000100:00100000:0.0:1788211774.651781:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:0.0:1788211774.651791:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:5600:x1875075637767552:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788211774.652050:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:5600:x1875075637767552:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 259us (610us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788211774.652065:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:3.0:1788211774.655060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211774.655193:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637767680 00000100:00100000:0.0:1788211774.655203:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637767680 00010000:00010000:0.0:1788211774.655248:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5993 expref: 23 pid: 9952 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211774.655307:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:0.0:1788211774.655318:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef888000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:2359:x1875075637767680:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211774.655336:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211774.655346:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5993 expref: 23 pid: 9952 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.655360:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5993 expref: 23 pid: 9952 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.655387:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a5d1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5993 expref: 23 pid: 9952 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.655406:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:0.0:1788211774.655411:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5e14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.655423:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.655430:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5e14 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211774.655501:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211774.655579:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef888000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:2359:x1875075637767680:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 263us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211774.655587:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 59 00010000:00010000:2.0:1788211774.655711:0:6717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655720:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211774.655767:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788211774.655772:0:6717:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211774.655805:0:6717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655821:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655831:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655839:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655846:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655851:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211774.655857:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655863:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655873:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:2.0:1788211774.655876:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211774.655880:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655887:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655900:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655906:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655919:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655925:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37aa00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211774.655928:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655935:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655943:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8abfc37ecf00) 00010000:00010000:2.0:1788211774.655946:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211774.655949:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655954:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.655997:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5dff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59d2 expref: 22 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.656012:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5e14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59d2 expref: 21 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211774.656019:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211774.656021:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211774.656023:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37a000, rc 0) 00000100:00100000:2.0:1788211774.656055:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:10566:x1875075637767296:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 8635us (8982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211774.656071:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 129 00000040:00080000:0.0:1788211775.611331:0:12117:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788211775.611339:0:12117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788211775.611387:0:12117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788211775.611394:0:12117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788211775.661594:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788211775.661811:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788211775.661817:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788211775.661873:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788211775.661880:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788211775.662088:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6461f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1875075660846592:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788211775.662411:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9ccf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788211775.680495:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6461f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1875075660846592:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788211775.701002:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211775.701533:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637767808 00000100:00100000:1.0:1788211775.701547:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637767808 00000100:00100000:1.0:1788211775.701648:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 130 00000100:00100000:1.0:1788211775.701663:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:10577:x1875075637767808:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788211775.702023:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788211775.702282:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:10577:x1875075637767808:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 619us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211775.702291:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 130 00000100:00100000:0.0:1788211775.729236:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211775.729339:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637768064 00000100:00100000:2.0:1788211775.729350:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637768064 00000100:00100000:2.0:1788211775.729417:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 131 00000100:00100000:2.0:1788211775.729430:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:10577:x1875075637768064:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211775.729456:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211775.729482:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a5e1b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.729900:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a5e22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.729918:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a5e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.729932:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a5e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211775.729947:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788211775.730140:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a5e1b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59d9 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.730162:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a5e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59d9 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.730221:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211775.730225:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211775.730229:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7a00, rc 0) 00000100:00100000:2.0:1788211775.730307:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:10577:x1875075637768064:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 879us (1087us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788211775.730315:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 131 00000100:00100000:2.0:1788211775.740605:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211775.740711:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637768192 00000100:00100000:3.0:1788211775.740721:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637768192 00000100:00100000:3.0:1788211775.740785:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1788211775.740796:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:2361:x1875075637768192:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211775.740813:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211775.740843:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a5e22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59d9 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211775.740863:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:3.0:1788211775.740869:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211775.740943:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:2361:x1875075637768192:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 148us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211775.740950:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1788211775.744404:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211775.744677:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637768448 00000100:00100000:2.0:1788211775.744687:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637768448 00000100:00100000:2.0:1788211775.744749:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 132 00000100:00100000:2.0:1788211775.744761:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:10577:x1875075637768448:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788211775.744856:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5e30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.744873:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5e30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.744885:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5e30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.745100:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5e30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.745108:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5e30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.745114:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5e30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.745135:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211775.745140:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5e30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.745147:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5e30 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.745161:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211775.745186:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788211775.745192:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5e30 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211775.745198:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5e30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211775.745365:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:10577:x1875075637768448:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 605us (970us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788211775.745373:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 132 00000040:00080000:2.0:1788211775.745488:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788211775.745493:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788211775.745993:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788211775.746003:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788211775.750816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211775.751395:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637768704 00000100:00100000:0.0:1788211775.751409:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637768704 00000100:00100000:0.0:1788211775.751484:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:0.0:1788211775.751506:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:10577:x1875075637768704:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788211775.751995:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+24:10577:x1875075637768704:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 499us (1190us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788211775.752004:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:2.0:1788211776.230433:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788211776.230458:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660846720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788211776.230541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211776.230652:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660846720 00000100:00100000:3.0:1788211776.230661:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660846720 00000100:00100000:3.0:1788211776.230738:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788211776.230748:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875075660846720:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788211776.230753:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788211776.230787:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211776.230855:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875075660846720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211776.230864:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788211776.230893:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660846720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788211776.677506:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211776.743338:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef889f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660847104:0@lo:400:kworker.0 00000100:00100000:3.0:1788211776.743430:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211776.743511:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788211776.743519:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660846976:0@lo:400:kworker.0 00000100:00100000:3.0:1788211776.743544:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211776.743563:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660847488:0@lo:400:kworker.0 00000100:00100000:3.0:1788211776.743590:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211776.743772:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660847104 00000100:00100000:2.0:1788211776.743805:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660847104 00000100:00100000:2.0:1788211776.743884:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660846976 00000100:00100000:2.0:1788211776.743888:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660846976 00000100:00100000:3.0:1788211776.744009:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788211776.744024:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660847104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211776.744106:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660847104:12345-0@lo:400:kworker.0 Request processed in 86us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211776.744114:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788211776.744192:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef889f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660847104:0@lo:400:kworker.0 00000100:00100000:2.0:1788211776.744490:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788211776.744499:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660846976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211776.744545:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660846976:12345-0@lo:400:kworker.0 Request processed in 48us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211776.744553:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1788211776.744573:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211776.744586:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660846976:0@lo:400:kworker.0 00000100:00100000:1.0:1788211776.744674:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660847488 00000100:00100000:1.0:1788211776.744681:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660847488 00000100:00100000:1.0:1788211776.744745:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788211776.744754:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660846848:0@lo:400:kworker.0 00000100:00100000:1.0:1788211776.744757:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875075660847488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211776.745161:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875075660847488:12345-0@lo:400:kworker.0 Request processed in 408us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211776.745202:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788211776.745228:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660847232:0@lo:400:kworker.0 00000100:00080000:0.0:1788211776.745246:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788211776.745266:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211776.745413:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660847488:0@lo:400:kworker.0 00000100:00100000:0.0:1788211776.745610:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660847232 00000100:00100000:0.0:1788211776.745615:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660847232 00000100:00100000:0.0:1788211776.745923:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788211776.746098:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875075660847232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211776.746298:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875075660847232:12345-0@lo:400:kworker.0 Request processed in 366us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211776.746305:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788211776.746709:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660847232:0@lo:400:kworker.0 00000100:00100000:3.0:1788211776.748405:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211776.748590:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660847360:0@lo:400:kworker.0 00000100:00100000:3.0:1788211776.748676:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211776.750348:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660847360 00000100:00100000:0.0:1788211776.750360:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660847360 00000100:00080000:1.0:1788211776.750439:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211776.750455:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788211776.750468:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875075660847360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211776.750572:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875075660847360:12345-0@lo:400:kworker.0 Request processed in 107us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211776.750580:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788211776.751008:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660847360:0@lo:400:kworker.0 00000100:00100000:2.0:1788211776.751328:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660846848 00000100:00100000:2.0:1788211776.751334:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660846848 00000100:00100000:2.0:1788211776.751415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788211776.751425:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3309:x1875075660846848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211776.751487:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3309:x1875075660846848:12345-0@lo:400:kworker.0 Request processed in 64us (3093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211776.751495:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788211776.751567:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660846848:0@lo:400:kworker.0 00000100:00100000:0.0:1788211777.254812:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:3.0:1788211777.254843:0:7940:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366560675440ns, next at 367560671735ns, rc = 0 00000100:00100000:0.0:1788211777.254845:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660847616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788211777.254959:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211777.255192:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660847616 00000100:00100000:3.0:1788211777.255202:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660847616 00000100:00100000:3.0:1788211777.255350:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788211777.255365:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660847616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211777.255421:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211777.255604:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660847616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211777.255651:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660847616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 289us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211777.255660:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000040:00080000:2.0:1788211777.652986:0:12168:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788211777.652997:0:12168:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788211777.653064:0:12168:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788211777.653072:0:12168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788211777.710129:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211777.758724:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211777.759434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211777.759463:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211777.759484:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211777.759508:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211777.759552:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637769088 00000100:00100000:2.0:1788211777.759561:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637769088 00000100:00100000:2.0:1788211777.759615:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637769216 00000100:00100000:2.0:1788211777.759618:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637769216 00000100:00100000:2.0:1788211777.759645:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:2.0:1788211777.759655:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637769088:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211777.759733:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637769088:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211777.759741:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:2.0:1788211777.759761:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:2.0:1788211777.759769:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637769216:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211777.759796:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637769216:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211777.759802:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:2.0:1788211777.759821:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637769344 00000100:00100000:2.0:1788211777.759825:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637769344 00000100:00100000:2.0:1788211777.759850:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637768960 00000100:00100000:2.0:1788211777.759852:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637768960 00000100:00100000:2.0:1788211777.759871:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 152 00000100:00100000:2.0:1788211777.759877:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2359:x1875075637769344:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211777.759906:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2359:x1875075637769344:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 29us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211777.759912:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 152 00000100:00100000:2.0:1788211777.759924:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 153 00000100:00100000:2.0:1788211777.759929:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdf30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+24:2359:x1875075637768960:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211777.759956:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdf30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+24:2359:x1875075637768960:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211777.759968:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 153 00000100:00080000:2.0:1788211777.759995:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788211777.759999:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788211777.760001:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788211777.761070:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637768832 00000100:00100000:3.0:1788211777.761080:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637768832 00000100:00100000:3.0:1788211777.761138:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 293 00000100:00100000:3.0:1788211777.761148:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637768832:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211777.761225:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637768832:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 78us (2511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211777.761233:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 293 00000001:00080000:1.0:1788211777.923432:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788211777.923584:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788211777.963298:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211777.966408:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637769600 00000100:00100000:3.0:1788211777.966435:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637769600 00000100:00100000:3.0:1788211777.966549:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 133 00000100:00100000:3.0:1788211777.966569:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+24:10598:x1875075637769600:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211777.966594:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211777.966636:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5e37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59e0 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211777.966796:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5e3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211777.966820:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5e3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211777.966838:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5e3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211777.966860:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788211777.967108:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5e37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59e0 expref: 27 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211777.967132:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5e3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59e0 expref: 26 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211777.967143:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:3.0:1788211777.967146:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788211777.967150:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063a00, rc 0) 00000100:00100000:3.0:1788211777.967374:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:10598:x1875075637769600:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 807us (4085us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788211777.967386:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 133 00000100:00100000:2.0:1788211777.975671:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211777.976076:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637769728 00000100:00100000:1.0:1788211777.976086:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637769728 00000100:00100000:1.0:1788211777.976224:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 134 00000100:00100000:1.0:1788211777.976234:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:10598:x1875075637769728:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:1.0:1788211777.976300:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211777.976316:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211777.976326:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211777.976353:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211777.976360:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211777.976367:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211777.976372:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211777.976377:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211777.976384:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211777.976394:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:1.0:1788211777.976396:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788211777.976400:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211777.976420:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211777.976497:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:10598:x1875075637769728:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 265us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211777.976504:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 134 00000100:00100000:3.0:1788211778.107650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211778.108150:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637769856 00000100:00100000:2.0:1788211778.108267:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637769856 00000100:00100000:2.0:1788211778.108379:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:2.0:1788211778.108398:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637769856:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1788211778.108424:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211778.108457:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000479a874f/0x2afbce82f55a5e53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59e7 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788211778.108491:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a95f23d, atime: 0x6a95f23d, ctime: 0x6a95f23d, blocks: 0xb 00010000:00010000:2.0:1788211778.108520:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:2.0:1788211778.108529:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211778.108546:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000479a874f/0x2afbce82f55a5e53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59e7 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211778.108582:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000479a874f/0x2afbce82f55a5e53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59e7 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211778.108604:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7800, rc 0) 00000100:00100000:2.0:1788211778.108720:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2358:x1875075637769856:12345-192.168.204.29@tcp:101:cat.0 Request processed in 324us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211778.108760:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:0.0:1788211778.120559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211778.120711:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637769984 00000100:00100000:3.0:1788211778.120722:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637769984 00002000:00100000:3.0:1788211778.120777:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8abff6460380 x1875075637769984/t0(0) o3->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:329/0 lens 488/0 e 0 to 0 dl 1788211789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211778.120814:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abff6460380 with x1875075637769984 ext(0->4095) 00002000:00010000:3.0:1788211778.120823:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8abff6460380 00000100:00100000:3.0:1788211778.120888:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:3.0:1788211778.120899:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2360:x1875075637769984:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1788211778.121496:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2360:x1875075637769984:12345-192.168.204.29@tcp:3:cat.0 Request processed in 595us (944us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788211778.121508:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00002000:00100000:3.0:1788211778.121519:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8abff6460380 x1875075637769984/t0(0) o3->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:329/0 lens 488/4536 e 0 to 0 dl 1788211789 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211778.121530:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abff6460380 with x1875075637769984 ext(0->4095) 00002000:00010000:3.0:1788211778.121538:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8abff6460380 00010000:00010000:2.0:1788211778.725481:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211779.750048:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788211779.908925:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:0.0:1788211779.908951:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788211779.908981:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8abfc3413000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788211779.908987:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abffe3d8a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8abfc3413900 00000020:00080000:0.0:1788211779.908991:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abffe3d8900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8abfca5dc400 00000001:00080000:0.0:1788211779.909021:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000004:00080000:0.0:1788211779.909028:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788211779.909371:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788211779.909556:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1788211779.910145:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660847744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788211779.910241:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211779.910309:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660847744 00000100:00100000:1.0:1788211779.910316:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660847744 00000100:00100000:1.0:1788211779.910365:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788211779.910374:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875075660847744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788211779.910572:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788211779.910576:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788211773 -> 1788211773 00002000:00010000:1.0:1788211779.910579:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1788211773 -> 1788211773 00002000:00010000:1.0:1788211779.910582:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788211773 -> 1788211773 00002000:00010000:1.0:1788211779.910584:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788211779.910621:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3308:x1875075660847744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 248us (380us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788211779.910628:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788211779.910649:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788211779.910676:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abff6462d80/2, rc 0, transno 4294967312 00000100:00100000:1.0:1788211779.910682:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660847744:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1788211779.919118:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788211779.919133:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1788211780.773372:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788211780.901661:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788211780.901670:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788211780.901710:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788211780.901718:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788211781.351780:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660847872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211781.351869:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211781.351929:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660847872 00000100:00100000:2.0:1788211781.351940:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660847872 00000100:00100000:2.0:1788211781.352039:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788211781.352051:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660847872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788211781.352085:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788211781.352247:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788211781.352566:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660847872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 516us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211781.352574:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788211781.353776:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788211781.353788:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788211781.353814:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac001242680, transno 4294967304 00000100:00100000:0.0:1788211781.353907:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660847872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788211781.800053:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211781.864349:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660848000:0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.864466:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211781.864522:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660848512:0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.864550:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211781.864578:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788211781.864584:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660848128:0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.864603:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211781.864618:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660848640:0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.864643:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211781.864694:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660848256:0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.864729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211781.864945:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211781.864952:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660848384:0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.864994:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211781.865033:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660848000 00000100:00100000:2.0:1788211781.865041:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660848000 00000100:00100000:2.0:1788211781.865268:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788211781.865278:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660848000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.865331:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660848000:12345-0@lo:400:kworker.0 Request processed in 55us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211781.865338:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788211781.865371:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660848512 00000100:00100000:2.0:1788211781.865375:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660848512 00000100:00100000:2.0:1788211781.865408:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660848128 00000100:00100000:2.0:1788211781.865411:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660848128 00000100:00100000:2.0:1788211781.865428:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660848256 00000100:00100000:2.0:1788211781.865431:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660848256 00000100:00100000:2.0:1788211781.865444:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788211781.865450:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660848512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.865482:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660848512:12345-0@lo:400:kworker.0 Request processed in 32us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211781.865487:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788211781.865498:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788211781.865504:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660848128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.865529:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660848128:12345-0@lo:400:kworker.0 Request processed in 25us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211781.865534:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788211781.865543:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788211781.865549:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660848256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.865589:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660848256:12345-0@lo:400:kworker.0 Request processed in 41us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211781.865595:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788211781.865617:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660848640 00000100:00100000:2.0:1788211781.865620:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660848640 00000100:00100000:2.0:1788211781.865647:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660848384 00000100:00100000:2.0:1788211781.865649:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660848384 00000100:00100000:2.0:1788211781.865668:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788211781.865688:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660848640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.865722:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660848640:12345-0@lo:400:kworker.0 Request processed in 47us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211781.865727:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788211781.865738:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788211781.865744:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660848384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.865779:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660848384:12345-0@lo:400:kworker.0 Request processed in 36us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211781.865785:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788211781.865809:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788211781.865814:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211781.867149:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660848384:0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.867193:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660848256:0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.867235:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660848128:0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.867247:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788211781.867251:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac001241500, transno 4294967309 00000004:00080000:2.0:1788211781.867264:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1788211781.867296:0:3310:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8abff6462d80 x1875075660847744/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788211795 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211781.867306:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660848640:0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.867320:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660848000:0@lo:400:kworker.0 00000100:00100000:2.0:1788211781.867331:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660848512:0@lo:400:kworker.0 00000100:00100000:2.0:1788211782.373351:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660848768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211782.373448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211782.373765:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660848768 00000100:00100000:1.0:1788211782.373775:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660848768 00000100:00100000:1.0:1788211782.373839:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788211782.373855:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875075660848768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788211782.373893:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211782.379711:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875075660848768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5844us (6249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211782.379727:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788211782.383687:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660848768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788211782.822310:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211782.881605:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211782.881655:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211782.881690:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211782.881709:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211782.881735:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211782.881766:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637770624 00000100:00100000:2.0:1788211782.881776:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637770624 00000100:00100000:2.0:1788211782.881832:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637770240 00000100:00100000:2.0:1788211782.881835:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637770240 00000100:00100000:2.0:1788211782.881855:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 157 00000100:00100000:2.0:1788211782.881865:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2360:x1875075637770624:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211782.881951:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2360:x1875075637770624:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 86us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211782.881959:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 157 00000100:00100000:2.0:1788211782.881978:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 158 00000100:00100000:2.0:1788211782.881985:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:2360:x1875075637770240:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211782.882039:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:2360:x1875075637770240:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 55us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211782.882045:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 158 00000100:00100000:2.0:1788211782.882066:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637770368 00000100:00100000:2.0:1788211782.882069:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637770368 00000100:00100000:2.0:1788211782.882093:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637770496 00000100:00100000:2.0:1788211782.882096:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637770496 00000100:00100000:1.0:1788211782.882268:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637770112 00000100:00100000:1.0:1788211782.882272:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637770112 00000100:00100000:1.0:1788211782.882302:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 295 00000100:00100000:1.0:1788211782.882307:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd86e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2360:x1875075637770112:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211782.882333:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd86e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2360:x1875075637770112:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211782.882338:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 295 00000100:00080000:1.0:1788211782.882393:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211782.882397:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788211782.882399:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211782.882418:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:1.0:1788211782.882425:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2360:x1875075637770368:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211782.882450:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2360:x1875075637770368:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211782.882456:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:1.0:1788211782.882636:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 74 00000100:00100000:1.0:1788211782.882644:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637770496:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211782.882673:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637770496:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211782.882679:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 74 00010000:00010000:2.0:1788211783.845547:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211784.874185:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788211785.043392:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788211785.043468:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788211785.043482:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1788211785.072674:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:3.0:1788211785.126513:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211785.127206:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637770752 00000100:00100000:2.0:1788211785.127217:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637770752 00000100:00100000:2.0:1788211785.127290:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 135 00000100:00100000:2.0:1788211785.127303:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:10242:x1875075637770752:12345-192.168.204.29@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788211785.127434:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:10242:x1875075637770752:12345-192.168.204.29@tcp:60:lhsmtool_posix.0 Request processed in 132us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211785.127442:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 135 00000100:00080000:0.0:1788211785.127807:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211785.130402:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211785.130479:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637771008 00000100:00100000:2.0:1788211785.130490:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637771008 00000100:00100000:2.0:1788211785.130615:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:2.0:1788211785.130627:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:10242:x1875075637771008:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788211785.131524:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:10242:x1875075637771008:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 896us (1128us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788211785.131535:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:2.0:1788211785.381752:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211785.382121:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637771136 00000100:00100000:1.0:1788211785.382133:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637771136 00000100:00100000:1.0:1788211785.382509:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 136 00000100:00100000:1.0:1788211785.382523:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd57119c-37bb-4375-96c6-4462114b4b2c+5:11051:x1875075637771136:12345-192.168.204.29@tcp:101:lsof.0 00010000:00010000:1.0:1788211785.382548:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211785.382636:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5e5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59ee expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211785.382725:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211785.382739:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211785.382751:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211785.383203:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788211785.383208:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788211785.383390:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211785.383420:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59ee expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211785.383438:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59ee expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211785.383447:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec100) 00010000:00010000:1.0:1788211785.383457:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788211785.383461:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37ae00, rc 0) 00000100:00100000:1.0:1788211785.383541:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd57119c-37bb-4375-96c6-4462114b4b2c+6:11051:x1875075637771136:12345-192.168.204.29@tcp:101:lsof.0 Request processed in 1020us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211785.383549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 136 00000100:00080000:0.0:1788211785.385802:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788211785.907098:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211786.469682:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660848896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211786.469774:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211786.470123:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660848896 00000100:00100000:0.0:1788211786.470131:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660848896 00000100:00100000:0.0:1788211786.470233:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788211786.470246:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660848896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788211786.470287:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211786.470345:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660848896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211786.470353:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788211786.470410:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660848896:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788211786.470480:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788211786.917874:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211786.982357:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660849152:0@lo:400:kworker.0 00000100:00100000:3.0:1788211786.982426:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211786.982514:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660849408:0@lo:400:kworker.0 00000100:00100000:0.0:1788211786.982556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211786.982567:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660849664:0@lo:400:kworker.0 00000100:00100000:0.0:1788211786.982599:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788211786.982600:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211786.982608:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660849280:0@lo:400:kworker.0 00000100:00100000:0.0:1788211786.982643:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211786.982653:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788211786.982663:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660849024:0@lo:400:kworker.0 00000100:00100000:0.0:1788211786.982701:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660849408 00000100:00100000:0.0:1788211786.982709:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660849408 00000100:00100000:3.0:1788211786.982963:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211786.982989:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660849536:0@lo:400:kworker.0 00000100:00100000:3.0:1788211786.983014:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211786.983041:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660849664 00000100:00100000:3.0:1788211786.983046:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660849664 00000100:00100000:1.0:1788211786.983163:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660849152 00000100:00100000:1.0:1788211786.983186:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660849152 00000100:00100000:0.0:1788211786.987853:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788211786.987878:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660849280 00000100:00100000:1.0:1788211786.987894:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660849280 00000100:00100000:0.0:1788211786.987907:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660849408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211786.987962:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660849536 00000100:00100000:1.0:1788211786.987966:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660849536 00000100:00100000:1.0:1788211786.987992:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788211786.988002:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660849152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211786.988054:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660849408:12345-0@lo:400:kworker.0 Request processed in 174us (5497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211786.988065:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788211786.988071:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660849152:12345-0@lo:400:kworker.0 Request processed in 70us (5644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211786.988080:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788211786.988100:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788211786.988104:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788211786.988115:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660849664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211786.988117:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660849280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211786.988184:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660849664:12345-0@lo:400:kworker.0 Request processed in 56us (5567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211786.988196:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788211786.988197:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660849280:12345-0@lo:400:kworker.0 Request processed in 80us (5550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211786.988206:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788211786.988220:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788211786.988227:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660849536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211786.988256:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660849536:12345-0@lo:400:kworker.0 Request processed in 30us (5242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211786.988262:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788211786.992568:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660849280:0@lo:400:kworker.0 00000100:00100000:1.0:1788211786.992587:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660849408:0@lo:400:kworker.0 00000100:00100000:1.0:1788211786.992662:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660849024 00000100:00100000:1.0:1788211786.992668:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660849024 00000100:00100000:1.0:1788211786.992740:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788211786.992749:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660849024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211786.992840:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660849024:12345-0@lo:400:kworker.0 Request processed in 91us (9877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211786.992847:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:1.0:1788211786.992909:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788211786.992917:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788211786.992938:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660849024:0@lo:400:kworker.0 00000100:00100000:1.0:1788211786.992950:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660849536:0@lo:400:kworker.0 00000100:00100000:1.0:1788211786.992961:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660849152:0@lo:400:kworker.0 00000100:00100000:1.0:1788211786.992972:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788211786.992977:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abff6462d80, transno 4294967312 00000100:00100000:1.0:1788211786.992988:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660849664:0@lo:400:kworker.0 00000100:00100000:2.0:1788211787.495614:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660849792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211787.495701:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211787.495900:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660849792 00000100:00100000:1.0:1788211787.495913:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660849792 00000100:00100000:1.0:1788211787.495998:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788211787.496011:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660849792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788211787.496074:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211787.496266:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660849792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 257us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211787.496306:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788211787.496441:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660849792:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788211787.941330:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211787.996490:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211787.996577:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637771392 00000100:00100000:1.0:1788211787.996587:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637771392 00000100:00100000:1.0:1788211787.996667:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 162 00000100:00100000:1.0:1788211787.996690:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:2358:x1875075637771392:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211787.996768:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:2358:x1875075637771392:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 92us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211787.996776:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 162 00000100:00080000:2.0:1788211787.997342:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211788.000721:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211788.000771:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211788.000817:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211788.000865:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637771776 00000100:00100000:3.0:1788211788.000876:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637771776 00000100:00100000:2.0:1788211788.000901:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637771520 00000100:00100000:2.0:1788211788.000905:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637771520 00000100:00100000:3.0:1788211788.000939:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 163 00000100:00100000:2.0:1788211788.000939:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:3.0:1788211788.000949:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd57119c-37bb-4375-96c6-4462114b4b2c+6:2359:x1875075637771776:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211788.001090:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637771520:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211788.001239:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637771264 00000100:00100000:0.0:1788211788.001244:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637771264 00000100:00100000:3.0:1788211788.001411:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd57119c-37bb-4375-96c6-4462114b4b2c+6:2359:x1875075637771776:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 458us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211788.001424:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 163 00000100:00080000:3.0:1788211788.001463:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788211788.001469:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211788.001968:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 297 00000100:00100000:0.0:1788211788.001981:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637771264:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211788.005995:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637771520:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 5032us (5208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211788.006012:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:2.0:1788211788.014972:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211788.017975:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637771648 00000100:00100000:3.0:1788211788.017992:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637771648 00000100:00100000:3.0:1788211788.018138:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:3.0:1788211788.018151:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637771648:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211788.018259:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637771648:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 110us (3297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211788.018268:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:0.0:1788211788.018988:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637771264:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 17004us (18270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211788.019007:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 297 00000100:00080000:2.0:1788211788.019367:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1788211788.568913:0:12372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 17:29:46 (1788211786) 00010000:00010000:2.0:1788211788.967734:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211789.989586:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788211790.117534:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788211790.117545:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788211790.119056:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788211790.119079:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788211790.143621:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000100:00100000:3.0:1788211790.261506:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211790.265672:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637772032 00000100:00100000:1.0:1788211790.265703:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637772032 00000100:00100000:1.0:1788211790.265965:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 137 00000100:00100000:1.0:1788211790.265979:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:11316:x1875075637772032:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788211790.266005:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211790.266036:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5e68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59f5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.266154:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e6f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.266195:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e6f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.266208:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e6f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.266306:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e76 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.266316:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.266322:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.266863:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5e7d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.266875:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5e7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.266884:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5e7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211790.266897:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788211790.267115:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e6f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267124:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e6f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267130:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e6f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267136:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37aa00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211790.267140:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e6f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267160:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e6f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267205:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8abfc9a0de00) 00010000:00010000:1.0:1788211790.267209:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211790.267215:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267221:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5e6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267237:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267244:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e76 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267249:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e76 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267255:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211790.267258:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e76 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267264:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e76 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267272:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8abfc37ec700) 00010000:00010000:1.0:1788211790.267275:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211790.267277:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e76 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267294:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5e76 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267737:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a5e68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59f5 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267755:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5e7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59f5 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.267764:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfc9a0db00) 00010000:00010000:1.0:1788211790.267767:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211790.267770:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37ba00, rc 0) 00000100:00100000:1.0:1788211790.267892:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:11316:x1875075637772032:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1914us (6402us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788211790.267904:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 137 00000100:00080000:2.0:1788211790.272861:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211790.278111:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211790.278268:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211790.278618:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637772288 00000100:00100000:1.0:1788211790.278633:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637772288 00000100:00100000:1.0:1788211790.278720:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:1.0:1788211790.278734:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:2358:x1875075637772288:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211790.278751:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211790.278780:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5e7d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59f5 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211790.278809:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfc9a0db00) 00010000:00010000:1.0:1788211790.278815:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211790.278889:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:2358:x1875075637772288:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 157us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211790.278912:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:0.0:1788211790.289292:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637772160 00000100:00100000:0.0:1788211790.289309:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637772160 00000100:00100000:0.0:1788211790.289399:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 138 00000100:00100000:0.0:1788211790.289412:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:11316:x1875075637772160:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788211790.289581:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:11316:x1875075637772160:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 Request processed in 172us (11483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211790.289609:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 138 00010000:00010000:0.0:1788211791.019555:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788211791.141378:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788211791.141391:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788211791.142268:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788211791.142286:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788211791.589657:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660849920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211791.589744:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211791.590553:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660849920 00000100:00100000:1.0:1788211791.590564:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660849920 00000100:00080000:2.0:1788211791.590694:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211791.590737:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788211791.590751:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660849920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788211791.590811:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211791.590890:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660849920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211791.590899:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788211791.590977:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660849920:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788211792.046033:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211792.103892:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660850176:0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.103984:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211792.104245:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660850688:0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.104289:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211792.104328:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788211792.104334:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660850048:0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.104366:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211792.104390:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660850560:0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.104412:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211792.104459:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660850304:0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.104484:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211792.104502:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211792.104506:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660850432:0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.104525:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211792.104557:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660850176 00000100:00100000:2.0:1788211792.104564:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660850176 00000100:00100000:2.0:1788211792.104603:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660850560 00000100:00100000:2.0:1788211792.104606:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660850560 00000100:00100000:2.0:1788211792.104631:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660850304 00000100:00100000:2.0:1788211792.104634:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660850304 00000100:00100000:2.0:1788211792.104653:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788211792.104662:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660850176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.104713:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660850176:12345-0@lo:400:kworker.0 Request processed in 51us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211792.104721:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788211792.104739:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788211792.104746:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660850560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.104787:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660850560:12345-0@lo:400:kworker.0 Request processed in 42us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211792.104793:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788211792.104805:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788211792.104811:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660850304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.104842:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660850304:12345-0@lo:400:kworker.0 Request processed in 31us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211792.104849:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788211792.104867:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660850688 00000100:00100000:2.0:1788211792.104876:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660850688 00000100:00100000:2.0:1788211792.104903:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660850432 00000100:00100000:2.0:1788211792.104906:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660850432 00000100:00100000:2.0:1788211792.104925:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788211792.104932:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660850688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.104965:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660850688:12345-0@lo:400:kworker.0 Request processed in 34us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211792.104971:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788211792.104983:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788211792.104989:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660850432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.105020:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660850432:12345-0@lo:400:kworker.0 Request processed in 31us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211792.105414:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788211792.105438:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660850048 00000100:00100000:2.0:1788211792.105443:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660850048 00000100:00100000:2.0:1788211792.105471:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788211792.105478:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660850048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.105516:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660850048:12345-0@lo:400:kworker.0 Request processed in 37us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211792.105521:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:2.0:1788211792.105556:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788211792.105561:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211792.105605:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660850432:0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.105617:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660850304:0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.105654:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660850048:0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.105664:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660850560:0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.105689:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660850176:0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.105699:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660850688:0@lo:400:kworker.0 00000100:00100000:2.0:1788211792.343310:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211792.343477:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637772416 00000100:00100000:3.0:1788211792.343489:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637772416 00000100:00100000:3.0:1788211792.343566:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 139 00000100:00100000:3.0:1788211792.343577:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:11358:x1875075637772416:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211792.343599:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211792.343619:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5e8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f59fc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.343699:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5e92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.343715:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5e92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.343726:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5e92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.343742:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5e99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.343749:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5e99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.343782:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5e99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788211792.344285:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788211792.344494:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5e92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344504:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5e92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344512:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5e92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344517:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211792.344521:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5e92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344529:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5e92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344543:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec100) 00010000:00010000:3.0:1788211792.344546:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211792.344550:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5e92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344556:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5e92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344567:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5e99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344573:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5e99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344585:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5e99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344590:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211792.344593:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5e99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344599:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5e99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344607:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8abfc5bbe500) 00010000:00010000:3.0:1788211792.344610:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211792.344613:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5e99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344619:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5e99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344660:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5e8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59fc expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344671:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec100) 00010000:00010000:3.0:1788211792.344674:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211792.344677:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5e8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59fc expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.344687:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062200, rc 0) 00000100:00100000:3.0:1788211792.344799:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:11358:x1875075637772416:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1223us (1498us total) trans 0 rc 301/301 00000100:00100000:3.0:1788211792.344819:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 139 00000100:00100000:1.0:1788211792.362266:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.362821:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637772672 00000100:00100000:2.0:1788211792.362835:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637772672 00000100:00100000:2.0:1788211792.362910:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 140 00000100:00100000:2.0:1788211792.362922:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:11358:x1875075637772672:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1788211792.363001:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211792.363032:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07200/0x2afbce82f55a5809 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5835 expref: 14 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.363051:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec100) 00010000:00010000:2.0:1788211792.363056:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211792.363481:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.363501:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59ee expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.363511:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.363730:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59ee expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.363745:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59ee expref: 5 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211792.363777:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875075660850816:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211792.363978:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211792.372258:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875075660850816:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211792.372297:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211792.372994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211792.373318:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637772800 00000100:00100000:0.0:1788211792.373328:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637772800 00010000:00010000:0.0:1788211792.373435:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59ee expref: 6 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211792.373481:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:0.0:1788211792.373494:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd57119c-37bb-4375-96c6-4462114b4b2c+6:2358:x1875075637772800:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211792.373512:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211792.373521:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59ee expref: 6 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.373537:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59ee expref: 6 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.373575:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5e61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59ee expref: 6 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.373592:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec100) 00010000:00010000:0.0:1788211792.373598:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.373609:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.373617:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.373650:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211792.373715:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2358:x1875075637772800:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 223us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211792.373724:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 60 00010000:00010000:0.0:1788211792.374120:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.374136:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.374159:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a5ea7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.374201:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a5ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.374210:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a5ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788211792.374696:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788211792.377251:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788211792.377270:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.377281:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.377289:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.377295:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211792.377300:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.377319:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.377345:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc37ec100) 00010000:00010000:1.0:1788211792.377348:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211792.377353:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.377360:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5ea0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788211792.378020:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf22c6c6 reply state 000000007127e6de transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a5ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211792.378035:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788211792.378192:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:11358:x1875075637772672:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 15248us (15912us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788211792.378200:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 140 00010000:00010000:0.0:1788211792.384692:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a5ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.384709:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a5ea7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.384717:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a5ea7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.384723:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211792.384728:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a5ea7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.384743:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a5ea7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.384770:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8abfdb434e00) 00010000:00010000:0.0:1788211792.384773:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211792.384779:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a5ea7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.384785:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a5ea7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211792.436904:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211792.437674:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637772928 00000100:00100000:3.0:1788211792.437689:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637772928 00000100:00100000:3.0:1788211792.437785:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 141 00000100:00100000:3.0:1788211792.437797:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:11367:x1875075637772928:12345-192.168.204.29@tcp:101:lctl.0 00010000:00010000:3.0:1788211792.437822:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211792.437849:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5eae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a03 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.437934:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5eb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.437948:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.437959:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211792.438026:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788211792.438030:0:9952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211792.438061:0:9952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.438089:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5eae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a03 expref: 16 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.438106:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a03 expref: 15 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.438133:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:3.0:1788211792.438136:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788211792.438140:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063c00, rc 0) 00000100:00100000:3.0:1788211792.438490:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:11367:x1875075637772928:12345-192.168.204.29@tcp:101:lctl.0 Request processed in 694us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211792.438498:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 141 00000100:00100000:1.0:1788211792.495999:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211792.496086:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637773056 00000100:00100000:3.0:1788211792.496098:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637773056 00000100:00100000:3.0:1788211792.496210:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 142 00000100:00100000:3.0:1788211792.496220:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+15:11373:x1875075637773056:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:3.0:1788211792.496238:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211792.496258:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5ebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a0a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496328:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5ec3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496341:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496351:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496367:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5eca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496374:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496399:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496553:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ed1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496561:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496568:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211792.496604:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1788211792.496608:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211792.496632:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496648:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496655:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5ec3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496663:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496668:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211792.496673:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496680:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5ec3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496698:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:3.0:1788211792.496700:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211792.496705:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5ec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496711:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5ec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496723:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496729:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5eca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496735:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5eca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.496740:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211792.496743:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5eca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.497041:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5eca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.497052:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8abfc5bbec00) 00010000:00010000:3.0:1788211792.497054:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211792.497057:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5eca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.497063:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5eca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.497113:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5ebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a0a expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.497128:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a0a expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.497135:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:3.0:1788211792.497137:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788211792.497140:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062600, rc 0) 00000100:00100000:2.0:1788211792.497609:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:11373:x1875075637773056:12345-192.168.204.29@tcp:101:bash.0 Request processed in 1387us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211792.497620:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 142 00000100:00100000:0.0:1788211792.501663:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211792.501834:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637773312 00000100:00100000:1.0:1788211792.501844:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637773312 00000100:00100000:1.0:1788211792.501921:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 143 00000100:00100000:1.0:1788211792.501933:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:11373:x1875075637773312:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788211792.501962:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211792.502073:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5ed8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a11 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.502392:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5edf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.502429:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5edf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.502442:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5edf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.502461:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ee6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.502469:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.502475:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788211792.504682:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788211792.504920:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5eed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.504936:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.504947:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.505705:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5edf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.505717:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5edf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.505723:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5edf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.505743:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211792.505759:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5edf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.505767:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5edf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.505783:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:1.0:1788211792.505787:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211792.505792:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5edf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.505798:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5edf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788211792.505815:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001000e04d reply state 00000000c7aa2f14 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211792.505827:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788211792.505880:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a5ed8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a11 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.505898:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a11 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.505906:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc37ec700) 00010000:00010000:1.0:1788211792.505909:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788211792.505911:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37ba00, rc 0) 00000100:00100000:1.0:1788211792.506681:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:11373:x1875075637773312:12345-192.168.204.29@tcp:101:bash.0 Request processed in 4745us (5027us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788211792.506704:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 143 00010000:00010000:2.0:1788211792.512810:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.512832:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ee6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.512839:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ee6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.512846:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211792.512852:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ee6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.512860:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ee6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.512883:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc37ec100) 00010000:00010000:2.0:1788211792.512886:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211792.512910:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ee6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.512927:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ee6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211792.514792:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.514883:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637773440 00000100:00100000:2.0:1788211792.514896:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637773440 00000100:00100000:2.0:1788211792.514982:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:2.0:1788211792.514993:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637773440:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1788211792.515012:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211792.515034:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a5efb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788211792.515065:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211792.515089:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:2.0:1788211792.515094:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211792.515104:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a5efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a18 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.515125:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a5efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a18 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.515140:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7000, rc 0) 00000100:00100000:2.0:1788211792.515258:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637773440:12345-192.168.204.29@tcp:101:bash.0 Request processed in 265us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211792.515265:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00080000:3.0:1788211792.515772:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211792.524731:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.524896:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637773568 00000100:00100000:2.0:1788211792.524932:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637773568 00000100:00100000:2.0:1788211792.525060:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:2.0:1788211792.525074:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:11373:x1875075637773568:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1788211792.525097:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211792.525120:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a1f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.525155:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a5efb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a18 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.525214:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211792.525220:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211792.525226:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a1f expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.525274:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a5efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a18 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.525290:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a5efb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a18 expref: 7 pid: 6696 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211792.525308:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875075660850944:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211792.525442:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788211792.529966:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.530019:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875075660850944:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211792.530073:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a1f expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211792.530102:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637773696 00000100:00100000:0.0:1788211792.530113:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637773696 00010000:00010000:2.0:1788211792.530137:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6600, rc 0) 00010000:00010000:0.0:1788211792.530255:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a5efb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a18 expref: 8 pid: 6696 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211792.530307:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:0.0:1788211792.530321:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2358:x1875075637773696:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211792.530342:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788211792.530382:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:11373:x1875075637773568:12345-192.168.204.29@tcp:101:bash.0 Request processed in 5309us (5666us total) trans 0 rc 0/0 00010000:00010000:0.0:1788211792.530387:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a5efb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a18 expref: 8 pid: 6696 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211792.530398:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 48 00010000:00010000:0.0:1788211792.530409:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a5efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a18 expref: 8 pid: 6696 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.530456:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a5efb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a18 expref: 7 pid: 6696 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.530472:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211792.530477:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211792.530486:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a1f expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.530497:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a1f expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.530540:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a1f expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211792.530556:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1875075660851072:192.168.204.29@tcp:105: 00000100:00100000:0.0:1788211792.530622:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe1139c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211792.533593:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1875075660851072:192.168.204.29@tcp:105: 00010000:00010000:2.0:1788211792.533624:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211792.533764:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637773696:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 3432us (3799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211792.533778:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:1.0:1788211792.534093:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.534145:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637773952 00000100:00100000:2.0:1788211792.534154:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637773952 00000100:00100000:2.0:1788211792.534522:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:2.0:1788211792.534535:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:11373:x1875075637773952:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:1.0:1788211792.534783:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1788211792.534794:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000001:00080000:2.0:1788211792.534921:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967418 00000100:00100000:2.0:1788211792.535070:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:11373:x1875075637773952:12345-192.168.204.29@tcp:35:bash.0 Request processed in 537us (976us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788211792.535083:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 36 00000020:00080000:2.0:1788211792.535090:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788211792.585310:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211792.585461:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637774208 00000100:00100000:3.0:1788211792.585474:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637774208 00000100:00100000:3.0:1788211792.585572:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 144 00000100:00100000:3.0:1788211792.585584:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:11383:x1875075637774208:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211792.585609:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211792.585637:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5f09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a26 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211792.585795:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788211792.585937:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5f09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a26 expref: 22 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.585955:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:3.0:1788211792.585958:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788211792.585963:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a5f09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a26 expref: 22 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.586008:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063600, rc 0) 00000100:00100000:3.0:1788211792.586088:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:11383:x1875075637774208:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 506us (793us total) trans 4294967420 rc 301/301 00000100:00100000:3.0:1788211792.586097:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 144 00000100:00100000:0.0:1788211792.599575:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.602720:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637774464 00000100:00100000:2.0:1788211792.602743:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637774464 00000100:00100000:2.0:1788211792.602924:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:2.0:1788211792.602938:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:11383:x1875075637774464:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1788211792.603472:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:11383:x1875075637774464:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 535us (3912us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788211792.603501:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:0.0:1788211792.606647:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211792.606849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.606934:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637774720 00000100:00100000:2.0:1788211792.606946:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637774720 00000100:00100000:2.0:1788211792.607046:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:2.0:1788211792.607058:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637774720:12345-192.168.204.29@tcp:16:kworker.0 00000100:00100000:2.0:1788211792.607277:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637774720:12345-192.168.204.29@tcp:16:kworker.0 Request processed in 221us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211792.607285:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:3.0:1788211792.607698:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637774592 00000100:00100000:3.0:1788211792.607704:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637774592 00002000:00100000:3.0:1788211792.607760:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8abfca8ca300 x1875075637774592/t0(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:343/0 lens 504/0 e 0 to 0 dl 1788211803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211792.607773:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abfca8ca300 with x1875075637774592 ext(0->12) 00002000:00010000:3.0:1788211792.607782:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8abfca8ca300 00000100:00100000:3.0:1788211792.607810:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:3.0:1788211792.607819:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637774592:12345-192.168.204.29@tcp:4:bash.0 00000100:00100000:3.0:1788211792.609110:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2361:x1875075637774592:12345-192.168.204.29@tcp:4:bash.0 Request processed in 1281us (2466us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788211792.609476:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00002000:00100000:3.0:1788211792.609491:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8abfca8ca300 x1875075637774592/t4294967305(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:343/0 lens 504/448 e 0 to 0 dl 1788211803 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211792.609503:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abfca8ca300 with x1875075637774592 ext(0->12) 00002000:00010000:3.0:1788211792.609512:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8abfca8ca300 00000100:00100000:2.0:1788211792.615296:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660851200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211792.615474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211792.618661:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660851200 00000100:00100000:1.0:1788211792.618759:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660851200 00000100:00100000:1.0:1788211792.618932:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788211792.618949:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660851200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788211792.619006:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211792.620840:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660851200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1880us (5351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211792.620861:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788211792.621532:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660851200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788211792.668342:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.668636:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637774848 00000100:00100000:2.0:1788211792.668652:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637774848 00000100:00100000:2.0:1788211792.668739:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 145 00000100:00100000:2.0:1788211792.668763:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:11389:x1875075637774848:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211792.668803:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211792.668839:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5f17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.668956:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.668973:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.668985:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211792.669080:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788211792.669085:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211792.669111:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.669143:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5f17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a2d expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.669904:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a2d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.669921:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211792.669925:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211792.669930:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7600, rc 0) 00000100:00100000:3.0:1788211792.670212:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:11389:x1875075637774848:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1446us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211792.670224:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 145 00000100:00100000:1.0:1788211792.680096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.680324:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637775104 00000100:00100000:2.0:1788211792.680343:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637775104 00000100:00100000:2.0:1788211792.680422:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 146 00000100:00100000:2.0:1788211792.680438:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:11389:x1875075637775104:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211792.680472:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211792.680514:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5f25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a34 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.680647:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a5f2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.680662:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a5f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.680699:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a5f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211792.680714:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788211792.681039:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5f25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a34 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.681068:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a5f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a34 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.681080:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc37ec700) 00010000:00010000:2.0:1788211792.681084:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211792.681089:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6e00, rc 0) 00000100:00100000:2.0:1788211792.681603:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+25:11389:x1875075637775104:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1164us (1521us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788211792.681616:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 146 00000100:00100000:0.0:1788211792.685475:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211792.685523:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.685739:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637775360 00000100:00100000:2.0:1788211792.685762:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637775360 00000100:00100000:1.0:1788211792.685803:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637775488 00000100:00100000:1.0:1788211792.685809:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637775488 00000100:00100000:2.0:1788211792.685853:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 147 00000100:00100000:2.0:1788211792.685866:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:11389:x1875075637775360:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211792.685895:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788211792.685905:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00010000:00010000:2.0:1788211792.685920:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5f3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a3b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211792.685926:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:2358:x1875075637775488:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211792.685952:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211792.685987:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a5f2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a34 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.686009:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc37ec700) 00010000:00010000:1.0:1788211792.686015:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211792.686092:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:2358:x1875075637775488:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 171us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211792.686101:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00010000:00010000:2.0:1788211792.686440:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a5f41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.686468:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a5f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.686480:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a5f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211792.686495:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788211792.686709:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a5f3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a3b expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.686740:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a5f41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a3b expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.686760:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc37ec700) 00010000:00010000:0.0:1788211792.686763:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788211792.686765:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7a00, rc 0) 00000100:00100000:0.0:1788211792.686812:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:11389:x1875075637775360:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 949us (1350us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788211792.686820:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 147 00000100:00100000:0.0:1788211792.695477:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211792.695632:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637775616 00000100:00100000:3.0:1788211792.695666:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637775616 00000100:00100000:3.0:1788211792.695767:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:3.0:1788211792.695789:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2360:x1875075637775616:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:3.0:1788211792.695866:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.695899:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a1f expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.695912:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788211792.695917:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788211792.695925:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.696247:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a1f expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.696266:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a1f expref: 8 pid: 6693 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211792.696298:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1875075660851328:192.168.204.29@tcp:104: 00000100:00100000:3.0:1788211792.696574:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef9bfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211792.701006:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1875075660851328:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211792.701042:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211792.702386:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.703968:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637775744 00000100:00100000:2.0:1788211792.703988:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637775744 00010000:00010000:2.0:1788211792.704049:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a1f expref: 9 pid: 6693 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211792.704152:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00100000:2.0:1788211792.704190:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2359:x1875075637775744:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211792.704210:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788211792.704235:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788211792.704238:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788211792 00002000:00010000:2.0:1788211792.704241:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788211792 00010000:00010000:2.0:1788211792.704248:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a1f expref: 9 pid: 6693 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.704262:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a1f expref: 9 pid: 6693 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.704293:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a5f02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a1f expref: 9 pid: 6693 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.704343:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788211792.704349:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788211792.704356:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.704368:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.704411:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211792.704487:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637775744:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 325us (2108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211792.704496:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 62 00010000:00010000:0.0:1788211792.705476:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.705496:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.705537:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.705548:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.705560:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.705593:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211792.705598:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.705610:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.705634:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211792.705641:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c182cc2f/0x2afbce82f55a5f4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211792.707728:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2360:x1875075637775616:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 11918us (12245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211792.707756:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:0.0:1788211792.716873:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211792.718457:0:12483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637776000 00000100:00100000:1.0:1788211792.718474:0:12483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637776000 00000100:00100000:1.0:1788211792.718547:0:12483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:1.0:1788211792.718559:0:12483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc64f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:11389:x1875075637776000:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:1.0:1788211792.718636:0:12483:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a5f41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a3b expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788211792.718970:0:12483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788211792.719021:0:12483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788211792.721490:0:12483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:1.0:1788211792.721613:0:12483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.721640:0:12483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5eed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a11 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.721649:0:12483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.722584:0:12483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a11 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.722605:0:12483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5eed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a11 expref: 30 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211792.722623:0:12483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef888000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12483:1875075660851456:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211792.722774:0:12483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788211792.730305:0:12483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef888000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12483:1875075660851456:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211792.730352:0:12483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211792.732033:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211792.732410:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637776128 00000100:00100000:1.0:1788211792.732422:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637776128 00010000:00010000:1.0:1788211792.732474:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5eed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a11 expref: 31 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211792.732520:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:1.0:1788211792.732656:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:2358:x1875075637776128:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211792.732679:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211792.732689:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5eed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a11 expref: 31 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.732706:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a11 expref: 31 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.732734:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a5eed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a11 expref: 31 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.732766:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc37ec700) 00010000:00010000:1.0:1788211792.732772:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.732783:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.732791:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211792.732826:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788211792.733085:0:12483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.733095:0:12483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788211792.733292:0:12483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1788211792.733731:0:12483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788211792.733891:0:12483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12483:1875075660851584:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1788211792.734437:0:12483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211792.734473:0:12483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef9bf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211792.734539:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+32:2358:x1875075637776128:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1998us (2502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211792.734552:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:0.0:1788211792.735125:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660851584 00000100:00100000:0.0:1788211792.735135:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660851584 00000100:00100000:0.0:1788211792.735226:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788211792.735237:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12483:x1875075660851584:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1788211792.735348:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12483:x1875075660851584:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 113us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211792.735357:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788211792.735693:0:12483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12483:1875075660851584:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1788211792.736685:0:12483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788211792.736800:0:12483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12483:1875075660851712:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1788211792.736869:0:12483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211792.737674:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660851712 00000100:00100000:0.0:1788211792.737686:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660851712 00000100:00100000:0.0:1788211792.737762:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788211792.737772:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12483:x1875075660851712:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1788211792.737985:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12483:x1875075660851712:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 214us (1115us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788211792.737994:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788211792.738148:0:12483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef9bfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211792.738282:0:12483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12483:1875075660851712:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1788211792.738351:0:12483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788211792.738394:0:12483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.738404:0:12483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.738423:0:12483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.738429:0:12483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211792.738434:0:12483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.738441:0:12483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.738458:0:12483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc37ec700) 00010000:00010000:3.0:1788211792.738461:0:12483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788211792.738465:0:12483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.738471:0:12483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a5f56 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788211792.739491:0:12483:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788211792.739623:0:12483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788211792.739636:0:12483:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382045468649ns, next at 383045465859ns, rc = 0 00000001:00080000:3.0:1788211792.739646:0:12483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788211792.739695:0:12483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc37ec700) 00010000:00010000:3.0:1788211792.739700:0:12483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788211792.739711:0:12483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a5f41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a3b expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211792.739870:0:12483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc64f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+33:11389:x1875075637776000:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 21311us (23006us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788211792.739899:0:12483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00000020:00080000:3.0:1788211792.739904:0:12483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788211792.744289:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211792.744492:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637776256 00000100:00100000:3.0:1788211792.744508:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637776256 00000100:00100000:3.0:1788211792.744605:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 148 00000100:00100000:3.0:1788211792.744619:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+33:11389:x1875075637776256:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211792.744655:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211792.744688:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5f5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a42 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.744791:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5f5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a42 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.744811:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5f5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a42 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.744836:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:3.0:1788211792.744840:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788211792.744846:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062200, rc 0) 00000100:00100000:3.0:1788211792.744936:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:11389:x1875075637776256:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 320us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211792.744944:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 148 00000100:00100000:2.0:1788211792.751273:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211792.751378:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637776512 00000100:00100000:3.0:1788211792.751391:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637776512 00000100:00100000:3.0:1788211792.751462:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:3.0:1788211792.751474:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:11389:x1875075637776512:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1788211792.751773:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+35:11389:x1875075637776512:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 299us (510us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788211792.751781:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:0.0:1788211792.816633:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.816740:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637776768 00000100:00100000:2.0:1788211792.816761:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637776768 00000100:00100000:2.0:1788211792.816824:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 149 00000100:00100000:2.0:1788211792.816834:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+35:11399:x1875075637776768:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211792.816859:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211792.816882:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5f64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a49 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211792.817027:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788211792.817156:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5f64 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a49 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.817446:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:2.0:1788211792.817462:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788211792.817469:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5f64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a49 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.817485:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7c00, rc 0) 00000100:00100000:2.0:1788211792.817585:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+36:11399:x1875075637776768:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 751us (963us total) trans 4294967434 rc 301/301 00000100:00100000:2.0:1788211792.817594:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 149 00000100:00100000:0.0:1788211792.829380:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211792.829487:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637776896 00000100:00100000:3.0:1788211792.829499:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637776896 00000100:00100000:3.0:1788211792.829562:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 150 00000100:00100000:3.0:1788211792.829573:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+36:11399:x1875075637776896:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1788211792.829658:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5f72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.829676:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5f72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.829689:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5f72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.829706:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.829713:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.829719:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.829933:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5f80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.829943:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.829969:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788211792.830021:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830036:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5f72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830043:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5f72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830050:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5f72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830056:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211792.830061:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5f72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830069:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5f72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830080:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:3.0:1788211792.830083:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211792.830087:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5f72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830094:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5f72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830104:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830115:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5f79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830119:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830121:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211792.830123:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830127:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830132:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc5bbe100) 00010000:00010000:3.0:1788211792.830133:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211792.830135:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5f79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830138:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830150:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830153:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5f80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830157:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5f80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830160:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211792.830197:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5f80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830204:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5f80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830213:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:3.0:1788211792.830215:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211792.830218:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5f80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211792.830224:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5f80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211792.830299:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+36:11399:x1875075637776896:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 727us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211792.830307:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 150 00000100:00100000:0.0:1788211792.832132:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211792.832649:0:12483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637777152 00000100:00100000:3.0:1788211792.832659:0:12483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637777152 00000100:00100000:3.0:1788211792.832721:0:12483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:3.0:1788211792.832731:0:12483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+36:11399:x1875075637777152:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1788211792.833359:0:12483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+37:11399:x1875075637777152:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 627us (1232us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788211792.833369:0:12483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:0.0:1788211792.861375:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.861519:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637777408 00000100:00100000:2.0:1788211792.861528:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637777408 00000100:00100000:2.0:1788211792.861573:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 151 00000100:00100000:2.0:1788211792.861579:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+37:11402:x1875075637777408:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211792.861598:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211792.861615:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5f87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a50 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.861696:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a5f8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.861712:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a5f8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.861722:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a5f8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.861735:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.861754:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.861777:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.861942:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5f9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.861950:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.861957:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211792.861966:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788211792.862078:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a5f8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862085:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a5f8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862092:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a5f8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862098:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211792.862103:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a5f8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862111:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a5f8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862123:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211792.862126:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211792.862138:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a5f8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862145:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a5f8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862161:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862213:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5f95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862218:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862223:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211792.862226:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862231:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862239:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc9a0d700) 00010000:00010000:2.0:1788211792.862241:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211792.862244:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5f95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862250:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a5f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862295:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5f87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a50 expref: 40 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862322:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a50 expref: 39 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.862330:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:2.0:1788211792.862332:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211792.862335:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6a00, rc 0) 00000100:00100000:2.0:1788211792.862416:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:11402:x1875075637777408:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 836us (1055us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788211792.862425:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 151 00000100:00100000:0.0:1788211792.865650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211792.865895:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637777536 00000100:00100000:2.0:1788211792.865908:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637777536 00000100:00100000:2.0:1788211792.865976:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 152 00000100:00100000:2.0:1788211792.865988:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:11402:x1875075637777536:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:2.0:1788211792.866090:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a5faa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.866110:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a5faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.866122:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a5faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.866150:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a5faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.866158:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a5faa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.866231:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a5faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.866252:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211792.866257:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a5faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.866266:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a5faa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.866280:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:2.0:1788211792.866284:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788211792.866289:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a5faa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211792.866296:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a5faa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211792.866379:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:11402:x1875075637777536:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 392us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211792.866387:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 152 00000100:00100000:1.0:1788211792.868693:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211792.868808:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637777792 00000100:00100000:3.0:1788211792.868820:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637777792 00000100:00100000:3.0:1788211792.868923:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:3.0:1788211792.868935:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:11402:x1875075637777792:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1788211792.869225:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+40:11402:x1875075637777792:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 291us (539us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788211792.869250:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:0.0:1788211793.034466:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211793.034626:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637778048 00000100:00100000:3.0:1788211793.034640:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637778048 00000100:00100000:3.0:1788211793.034715:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 153 00000100:00100000:3.0:1788211793.034726:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+40:11433:x1875075637778048:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:3.0:1788211793.034763:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211793.034787:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5fb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a57 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.034916:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5fb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.034932:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.034945:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211793.035520:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788211793.035711:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5fb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a57 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.035749:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a57 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.035760:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:3.0:1788211793.035763:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211793.035768:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063800, rc 0) 00000100:00100000:3.0:1788211793.035947:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:11433:x1875075637778048:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1220us (1494us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788211793.035956:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 153 00000100:00100000:0.0:1788211793.041348:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211793.041452:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211793.041520:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637778176 00000100:00100000:2.0:1788211793.041535:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637778176 00000100:00100000:2.0:1788211793.041620:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1788211793.041633:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:2359:x1875075637778176:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211793.041654:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211793.041685:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a5fb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a57 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.041733:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:2.0:1788211793.041750:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211793.041813:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+41:2359:x1875075637778176:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 183us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211793.041822:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:3.0:1788211793.041931:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637778432 00000100:00100000:3.0:1788211793.041937:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637778432 00000100:00100000:3.0:1788211793.041979:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:3.0:1788211793.041988:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+41:11433:x1875075637778432:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:3.0:1788211793.042315:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:11433:x1875075637778432:12345-192.168.204.29@tcp:35:cat.0 Request processed in 327us (862us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788211793.042323:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 42 00010000:00010000:0.0:1788211793.061554:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211793.104626:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211793.105465:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637778688 00000100:00100000:2.0:1788211793.105477:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637778688 00000100:00100000:2.0:1788211793.105550:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 154 00000100:00100000:2.0:1788211793.105563:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:11439:x1875075637778688:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1788211793.105587:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211793.105590:0:6717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788211793.105619:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a5f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a2d expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.105647:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211793.105654:0:6717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211793.105670:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a5fc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a5e expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.105822:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.105843:0:6717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5f9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a50 expref: 42 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.105856:0:6717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.106550:0:6717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a50 expref: 42 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.106581:0:6717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a50 expref: 42 pid: 9952 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211793.106604:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe055500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660851840:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211793.106796:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211793.115579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211793.115689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211793.115752:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211793.115864:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211793.116041:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637778944 00000100:00100000:2.0:1788211793.116059:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637778944 00000100:00100000:2.0:1788211793.116209:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:2.0:1788211793.116226:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637778944:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211793.116345:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2360:x1875075637778944:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 121us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211793.116355:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:2.0:1788211793.116407:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe055500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660851840:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211793.116438:0:6717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211793.120131:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637779072 00000100:00100000:3.0:1788211793.120148:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637779072 00000100:00100000:3.0:1788211793.120247:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 167 00000100:00100000:3.0:1788211793.120256:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2360:x1875075637779072:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211793.121863:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2360:x1875075637779072:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 1597us (6187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211793.121876:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 167 00000100:00080000:0.0:1788211793.122117:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788211793.122396:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637778816 00000100:00100000:1.0:1788211793.122405:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637778816 00000100:00100000:1.0:1788211793.122463:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 299 00000100:00100000:1.0:1788211793.122476:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2360:x1875075637778816:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211793.122577:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2360:x1875075637778816:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 101us (7013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211793.122585:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 299 00000100:00100000:1.0:1788211793.122651:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637779200 00000100:00100000:1.0:1788211793.122659:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637779200 00010000:00010000:1.0:1788211793.122729:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a50 expref: 43 pid: 9952 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211793.122790:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:1.0:1788211793.122805:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+43:2359:x1875075637779200:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211793.122825:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211793.122838:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a50 expref: 43 pid: 9952 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211793.122859:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a50 expref: 43 pid: 9952 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211793.122899:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a5f9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a50 expref: 43 pid: 9952 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211793.122956:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:1.0:1788211793.122965:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211793.122984:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211793.122999:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211793.123050:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211793.123098:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:2359:x1875075637779200:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 295us (7232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211793.123106:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 64 00010000:00010000:1.0:1788211793.123161:0:6717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211793.123213:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211793.123233:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788211793.123401:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a5fc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a5e expref: 43 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211793.123416:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a5e expref: 42 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211793.123423:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:1.0:1788211793.123431:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788211793.123435:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7c00, rc 0) 00000100:00100000:1.0:1788211793.123460:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:11439:x1875075637778688:12345-192.168.204.29@tcp:101:dd.0 Request processed in 17899us (18845us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788211793.123470:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 154 00000100:00100000:2.0:1788211793.128143:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211793.128553:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637779456 00000100:00100000:0.0:1788211793.128571:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637779456 00000100:00100000:0.0:1788211793.128660:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 155 00000100:00100000:0.0:1788211793.128701:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:11439:x1875075637779456:12345-192.168.204.29@tcp:36:dd.0 00010000:00010000:0.0:1788211793.129146:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5fdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211793.129210:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211793.129229:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788211793.129315:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:0.0:1788211793.129362:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006862cb55 reply state 000000004eb2faaa transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211793.129377:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788211793.129552:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+45:11439:x1875075637779456:12345-192.168.204.29@tcp:36:dd.0 Request processed in 854us (1420us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788211793.129564:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 155 00000020:00080000:0.0:1788211793.129572:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788211793.145750:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.145768:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5fdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.145777:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5fdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.145784:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cda00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211793.145789:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5fdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.145805:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5fdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.145823:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:3.0:1788211793.145826:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211793.145830:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5fdb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.145836:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a5fdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788211793.203842:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1788211793.203865:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1788211793.502846:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211793.503026:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637779584 00000100:00100000:3.0:1788211793.503043:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637779584 00000100:00100000:3.0:1788211793.503131:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 156 00000100:00100000:3.0:1788211793.503143:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+44:11453:x1875075637779584:12345-192.168.204.29@tcp:101:stat.0 00010000:00010000:3.0:1788211793.503205:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211793.503414:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5fe2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.503507:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5fe9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.503527:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.503543:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.503594:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5ff0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.503603:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.503611:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.503771:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5ff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.503786:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a5e expref: 45 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.503797:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5ff7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.503862:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a5e expref: 45 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.503881:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a5e expref: 45 pid: 6717 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211793.503898:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660851968:192.168.204.29@tcp:104: 00000100:00100000:3.0:1788211793.504044:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef9bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211793.506324:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660851968:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211793.506363:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5ff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211793.507657:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211793.507832:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637779840 00000100:00100000:3.0:1788211793.507849:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637779840 00000100:00100000:3.0:1788211793.508139:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:3.0:1788211793.508233:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+46:5599:x1875075637779840:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788211793.508863:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+47:5599:x1875075637779840:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 632us (1203us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1788211793.508881:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:0.0:1788211793.512218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211793.512452:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637779968 00000100:00100000:2.0:1788211793.512465:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637779968 00010000:00010000:2.0:1788211793.512524:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a5e expref: 47 pid: 6717 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211793.512598:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:2.0:1788211793.512611:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+47:2359:x1875075637779968:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211793.512635:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211793.512643:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a5e expref: 47 pid: 6717 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.512660:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a5e expref: 47 pid: 6717 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.512691:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a5fcd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a5e expref: 47 pid: 6717 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.512714:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:2.0:1788211793.512720:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5ff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.512739:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.512750:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5ff7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.512789:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211793.512881:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+46:2359:x1875075637779968:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 269us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211793.512889:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 65 00010000:00010000:3.0:1788211793.513288:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513305:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211793.513380:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788211793.513386:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211793.513427:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513449:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513464:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513475:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5fe9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513497:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513533:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211793.513541:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513552:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5fe9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513572:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:3.0:1788211793.513603:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211793.513611:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5fe9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513620:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a5fe9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513640:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513648:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5ff0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513658:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513665:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211793.513669:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513676:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5ff0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513718:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc5bbe100) 00010000:00010000:3.0:1788211793.513723:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211793.513741:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5ff0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513752:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a5ff0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513821:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a5fe2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a65 expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513848:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a65 expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.513858:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:3.0:1788211793.513863:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211793.513867:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063400, rc 0) 00000100:00100000:3.0:1788211793.514391:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+45:11453:x1875075637779584:12345-192.168.204.29@tcp:101:stat.0 Request processed in 11243us (11554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211793.514404:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 156 00000100:00100000:0.0:1788211793.581123:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211793.581577:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637780224 00000100:00100000:1.0:1788211793.581588:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637780224 00000100:00100000:1.0:1788211793.581658:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 157 00000100:00100000:1.0:1788211793.581670:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+45:11459:x1875075637780224:12345-192.168.204.29@tcp:36:truncate.0 00010000:00010000:1.0:1788211793.581762:0:6717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211793.581800:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a5ff7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a65 expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211793.581825:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:1.0:1788211793.581846:0:6717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788211793.582157:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ffe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211793.582220:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ffe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211793.582232:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ffe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788211793.582292:0:6717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:1.0:1788211793.582322:0:6717:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009adbb7b8 reply state 00000000f8789a86 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ffe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211793.582331:0:6717:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788211793.582482:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+47:11459:x1875075637780224:12345-192.168.204.29@tcp:36:truncate.0 Request processed in 813us (1373us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1788211793.582490:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 157 00000020:00080000:1.0:1788211793.582496:0:6717:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788211793.587204:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ffe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.587251:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ffe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.587259:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ffe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.587266:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211793.587273:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ffe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.587281:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ffe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.587305:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:2.0:1788211793.587309:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211793.587314:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ffe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.587321:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a5ffe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211793.760579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211793.760776:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637780352 00000100:00100000:2.0:1788211793.760791:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637780352 00000100:00100000:2.0:1788211793.760885:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 158 00000100:00100000:2.0:1788211793.760897:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+46:11473:x1875075637780352:12345-192.168.204.29@tcp:101:stat.0 00010000:00010000:2.0:1788211793.760936:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211793.760965:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a6005 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a6c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761058:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a600c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761096:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a600c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761114:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a600c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761133:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761142:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761149:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761336:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761345:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761353:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211793.761396:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788211793.761401:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211793.761427:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761442:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761464:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a600c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761471:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a600c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761478:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a600c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761484:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211793.761490:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a600c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761498:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a600c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761512:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211793.761516:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211793.761520:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a600c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761528:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a600c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761545:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761552:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6013 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761558:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761568:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211793.761571:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761577:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6013 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761586:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211793.761588:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211793.761591:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6013 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761597:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761633:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a6005 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a6c expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761647:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a6c expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211793.761655:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:2.0:1788211793.761658:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211793.761660:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6800, rc 0) 00000100:00100000:2.0:1788211793.761745:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+47:11473:x1875075637780352:12345-192.168.204.29@tcp:101:stat.0 Request processed in 850us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211793.761755:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 158 00000100:00100000:1.0:1788211793.939908:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211793.939984:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637780608 00000100:00100000:3.0:1788211793.939997:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637780608 00000100:00100000:3.0:1788211793.940071:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 159 00000100:00100000:3.0:1788211793.940087:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+47:11483:x1875075637780608:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211793.940110:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211793.940130:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a6021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211793.940325:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788211793.940584:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a6021 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a73 expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.940600:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:3.0:1788211793.940602:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788211793.940607:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a6021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a73 expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211793.940625:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062400, rc 0) 00000100:00100000:3.0:1788211793.940707:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+48:11483:x1875075637780608:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 623us (811us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1788211793.940715:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 159 00000100:00100000:3.0:1788211793.944458:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211793.945436:0:12483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637780864 00000100:00100000:1.0:1788211793.945450:0:12483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637780864 00000100:00100000:0.0:1788211793.945708:0:12483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:0.0:1788211793.945730:0:12483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc64fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+48:11483:x1875075637780864:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1788211793.946192:0:12483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc64fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+49:11483:x1875075637780864:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 473us (1750us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788211793.946202:0:12483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:0.0:1788211794.012430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211794.012525:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637781120 00000100:00100000:3.0:1788211794.012535:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637781120 00000100:00100000:3.0:1788211794.012607:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 160 00000100:00100000:3.0:1788211794.012620:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+49:11489:x1875075637781120:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:3.0:1788211794.012642:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211794.012662:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a602f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a7a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.012782:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.012798:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a6c expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.012821:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.012858:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a6c expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.012872:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a6c expref: 50 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211794.012886:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660852096:192.168.204.29@tcp:104: 00000100:00100000:3.0:1788211794.012986:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef9bfc00 going to sleep for 11 seconds 00000100:00080000:0.0:1788211794.013107:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211794.019141:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211794.019386:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637781248 00000100:00100000:0.0:1788211794.019398:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637781248 00010000:00010000:0.0:1788211794.019451:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a6c expref: 51 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211794.019520:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00100000:0.0:1788211794.019532:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:2358:x1875075637781248:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211794.019551:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211794.019560:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a6c expref: 51 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.019574:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a6c expref: 51 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.019605:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:0.0:1788211794.019612:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.019624:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.019633:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.019661:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211794.019744:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:2358:x1875075637781248:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 214us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211794.019752:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 66 00010000:00010000:3.0:1788211794.020532:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a601a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a6c expref: 50 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211794.020558:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875075660852096:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211794.020585:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.020594:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.020601:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211794.020623:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788211794.020840:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a602f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a7a expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.020879:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a7a expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.020887:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:3.0:1788211794.020890:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788211794.020893:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062000, rc 0) 00000100:00100000:3.0:1788211794.020950:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+50:11489:x1875075637781120:12345-192.168.204.29@tcp:101:bash.0 Request processed in 8333us (8530us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788211794.020960:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 160 00000100:00100000:1.0:1788211794.024747:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211794.026362:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637781504 00000100:00100000:2.0:1788211794.026395:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637781504 00000100:00100000:2.0:1788211794.026466:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 161 00000100:00100000:2.0:1788211794.026477:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+50:11489:x1875075637781504:12345-192.168.204.29@tcp:36:bash.0 00010000:00010000:2.0:1788211794.026838:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6044 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.026858:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.026871:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788211794.026925:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:2.0:1788211794.026953:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e97928c reply state 000000003e9c1314 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211794.026963:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788211794.027363:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+53:11489:x1875075637781504:12345-192.168.204.29@tcp:36:bash.0 Request processed in 884us (2638us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788211794.027373:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 161 00000020:00080000:2.0:1788211794.027380:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788211794.035619:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.035643:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6044 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.035651:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6044 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.035658:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211794.035663:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6044 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.035843:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6044 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.035868:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:3.0:1788211794.035872:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211794.035878:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6044 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.035984:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a6044 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211794.043522:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211794.043959:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637781632 00000100:00100000:2.0:1788211794.043977:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637781632 00000100:00100000:2.0:1788211794.044069:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 162 00000100:00100000:2.0:1788211794.044082:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:11489:x1875075637781632:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1788211794.044115:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211794.044155:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a604b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a81 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.044328:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a6052 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.044373:0:6717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a7a expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.044383:0:6717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a6052 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.044426:0:6717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a7a expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.044443:0:6717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a7a expref: 53 pid: 5845 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211794.044460:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe055f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660852224:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211794.044576:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788211794.048488:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211794.048587:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637781760 00000100:00100000:0.0:1788211794.048598:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637781760 00010000:00010000:0.0:1788211794.048652:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a7a expref: 54 pid: 5845 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211794.048731:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 67 00000100:00100000:0.0:1788211794.048742:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:2358:x1875075637781760:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211794.048758:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211794.048765:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a7a expref: 54 pid: 5845 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.048781:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a7a expref: 54 pid: 5845 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.048812:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:0.0:1788211794.048818:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a6052 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.048841:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a6052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.048850:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a6052 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.048878:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211794.049066:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a6036 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a7a expref: 54 pid: 5845 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211794.049085:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe055f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660852224:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211794.049108:0:6717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a6052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.049118:0:6717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a6052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.049124:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a6052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211794.049242:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788211794.049256:0:6717:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211794.049284:0:6717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a6052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.049320:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a604b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a81 expref: 54 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.049338:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a6052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a81 expref: 53 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.049348:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:2.0:1788211794.049352:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211794.049355:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7200, rc 0) 00000100:00100000:0.0:1788211794.049839:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+53:2358:x1875075637781760:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1083us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211794.049851:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 67 00000100:00100000:2.0:1788211794.050022:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:11489:x1875075637781632:12345-192.168.204.29@tcp:101:bash.0 Request processed in 5941us (6511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211794.050031:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 162 00000100:00100000:0.0:1788211794.057498:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211794.057611:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637782016 00000100:00100000:3.0:1788211794.057624:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637782016 00000100:00100000:3.0:1788211794.057734:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:3.0:1788211794.057746:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:11489:x1875075637782016:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:3.0:1788211794.058380:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+53:11489:x1875075637782016:12345-192.168.204.29@tcp:35:bash.0 Request processed in 634us (892us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1788211794.058389:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 45 00010000:00010000:1.0:1788211794.085363:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211794.157787:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211794.158112:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637782272 00000100:00100000:3.0:1788211794.158125:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637782272 00000100:00100000:3.0:1788211794.158247:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 163 00000100:00100000:3.0:1788211794.158260:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+53:11499:x1875075637782272:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211794.158290:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211794.158314:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a6059 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a88 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211794.158474:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788211794.158632:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a6059 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a88 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.158648:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:3.0:1788211794.158651:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788211794.158656:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a6059 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a88 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.158692:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062400, rc 0) 00000100:00100000:3.0:1788211794.158764:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:11499:x1875075637782272:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 507us (999us total) trans 4294967452 rc 301/301 00000100:00100000:3.0:1788211794.158771:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 163 00000100:00100000:1.0:1788211794.176111:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211794.176393:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637782400 00000100:00100000:3.0:1788211794.176408:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637782400 00000100:00100000:2.0:1788211794.176735:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 164 00000100:00100000:2.0:1788211794.176748:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:11499:x1875075637782400:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1788211794.176850:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6067 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.176871:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6067 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.176885:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6067 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.176904:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a606e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.176929:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a606e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.176936:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a606e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177040:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6075 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177049:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177055:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788211794.177102:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177114:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6067 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177120:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6067 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177126:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6067 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177131:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211794.177136:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6067 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177144:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6067 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177162:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211794.177190:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211794.177195:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6067 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177201:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6067 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177216:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a606e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177223:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a606e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177229:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a606e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177235:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211794.177238:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a606e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177244:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a606e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177253:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211794.177255:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211794.177258:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a606e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177265:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a606e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177293:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177299:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6075 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177305:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177310:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211794.177313:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177319:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6075 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177326:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:2.0:1788211794.177329:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211794.177331:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6075 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.177337:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6075 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211794.177429:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:11499:x1875075637782400:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 682us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211794.177438:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 164 00000100:00100000:0.0:1788211794.190559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211794.191035:0:12483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637782656 00000100:00100000:3.0:1788211794.191052:0:12483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637782656 00000100:00100000:3.0:1788211794.191143:0:12483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:3.0:1788211794.191155:0:12483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:11499:x1875075637782656:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1788211794.192041:0:12483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:11499:x1875075637782656:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 816us (1422us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788211794.192055:0:12483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:1.0:1788211794.220634:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211794.220740:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637782912 00000100:00100000:2.0:1788211794.220755:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637782912 00000100:00100000:2.0:1788211794.220825:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 165 00000100:00100000:2.0:1788211794.220862:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:11503:x1875075637782912:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211794.220895:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211794.220920:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a607c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a8f expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221014:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6083 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221030:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6083 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221042:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6083 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221057:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a608a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221065:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a608a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221072:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a608a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221253:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6091 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221263:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221270:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211794.221289:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788211794.221410:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6083 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221419:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6083 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221427:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6083 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221434:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211794.221438:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6083 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221447:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6083 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221461:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211794.221464:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211794.221469:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6083 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221475:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6083 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221489:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a608a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221494:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a608a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221509:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a608a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221515:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211794.221518:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a608a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221524:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a608a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221534:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211794.221536:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211794.221539:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a608a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221545:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a608a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221592:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a607c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a8f expref: 58 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221607:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a8f expref: 57 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.221615:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:2.0:1788211794.221617:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211794.221620:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6400, rc 0) 00000100:00100000:2.0:1788211794.221700:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:11503:x1875075637782912:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 843us (1078us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788211794.221729:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 165 00000100:00100000:1.0:1788211794.224481:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211794.224552:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211794.224632:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637783168 00000100:00100000:3.0:1788211794.224638:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637783040 00000100:00100000:3.0:1788211794.224643:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637783040 00000100:00100000:2.0:1788211794.224650:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637783168 00000100:00100000:2.0:1788211794.224705:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 166 00000100:00100000:3.0:1788211794.224706:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:3.0:1788211794.224726:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+58:2358:x1875075637783040:12345-192.168.204.29@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788211794.224728:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+58:11503:x1875075637783168:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:3.0:1788211794.224744:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211794.224770:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6091 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a8f expref: 58 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.224794:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:2.0:1788211794.224794:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a609f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211794.224799:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211794.224810:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a609f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.224821:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a609f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.224862:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a609f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.224870:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a609f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.224878:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a609f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211794.225041:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:2358:x1875075637783040:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 326us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211794.225075:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00010000:00010000:2.0:1788211794.225368:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211794.225375:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a609f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.225386:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a609f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.225396:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:2.0:1788211794.225405:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788211794.225410:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a609f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.225416:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a609f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211794.225474:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:11503:x1875075637783168:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 760us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211794.225483:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 166 00000100:00100000:1.0:1788211794.229493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211794.229538:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637783424 00000100:00100000:2.0:1788211794.229551:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637783424 00000100:00100000:2.0:1788211794.229613:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:2.0:1788211794.229624:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:11503:x1875075637783424:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1788211794.229962:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:11503:x1875075637783424:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 339us (476us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788211794.229970:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:0.0:1788211794.343406:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211794.343533:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637783680 00000100:00100000:2.0:1788211794.343549:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637783680 00000100:00100000:2.0:1788211794.343626:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 167 00000100:00100000:2.0:1788211794.343639:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:11521:x1875075637783680:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1788211794.343673:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211794.343699:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.344034:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a60ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.344053:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a60ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.344072:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a60ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211794.344088:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788211794.344403:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a96 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.344422:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a60ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a96 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.344431:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:2.0:1788211794.344435:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788211794.344438:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6200, rc 0) 00000100:00100000:2.0:1788211794.344514:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:11521:x1875075637783680:12345-192.168.204.29@tcp:101:cat.0 Request processed in 877us (1123us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788211794.344522:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 167 00000100:00100000:1.0:1788211794.365019:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211794.365145:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637783808 00000100:00100000:2.0:1788211794.365156:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637783808 00000100:00100000:2.0:1788211794.365313:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 168 00000100:00100000:2.0:1788211794.365328:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:11522:x1875075637783808:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211794.365361:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211794.365387:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5a9d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.365474:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a60c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.365515:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a60c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.365528:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a60c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211794.365614:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788211794.365619:0:6717:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211794.365647:0:6717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a60c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.365682:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a9d expref: 61 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.365705:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a60c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a9d expref: 60 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.365726:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211794.365730:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211794.365734:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7e00, rc 0) 00000100:00100000:2.0:1788211794.365815:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:11522:x1875075637783808:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 491us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211794.365822:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 168 00000100:00100000:1.0:1788211794.369851:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211794.370377:0:12483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637784192 00000100:00100000:3.0:1788211794.370388:0:12483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637784192 00000100:00100000:3.0:1788211794.370451:0:12483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:3.0:1788211794.370460:0:12483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:11522:x1875075637784192:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1788211794.370836:0:12483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:11522:x1875075637784192:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 376us (1005us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788211794.370845:0:12483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:1.0:1788211794.372644:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211794.372761:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637784320 00000100:00100000:0.0:1788211794.372785:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637784320 00000100:00100000:0.0:1788211794.372980:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:0.0:1788211794.372991:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:11522:x1875075637784320:12345-192.168.204.29@tcp:103:lfs.0 00010000:00010000:0.0:1788211794.373007:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788211794.373040:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a6052 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a81 expref: 61 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.373065:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a60ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a96 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.373077:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a5f5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a42 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211794.373087:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbec00) 00010000:00010000:0.0:1788211794.373099:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211794.373188:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+58:11522:x1875075637784320:12345-192.168.204.29@tcp:103:lfs.0 Request processed in 174us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211794.373197:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:1.0:1788211794.374695:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211794.374813:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637784448 00000100:00100000:2.0:1788211794.374823:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637784448 00000100:00100000:2.0:1788211794.374879:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 169 00000100:00100000:2.0:1788211794.374889:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+58:11522:x1875075637784448:12345-192.168.204.29@tcp:58:lfs.0 00010000:00010000:2.0:1788211794.375010:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.375043:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.375058:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788211794.375484:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788211794.375621:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+58:11522:x1875075637784448:12345-192.168.204.29@tcp:58:lfs.0 Request processed in 731us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211794.375630:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 169 00000100:00100000:1.0:1788211794.403407:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211794.403608:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637784576 00000100:00100000:2.0:1788211794.403620:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637784576 00000100:00100000:2.0:1788211794.403701:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 170 00000100:00100000:2.0:1788211794.403723:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+58:11524:x1875075637784576:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211794.403751:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211794.403778:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a60d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5aa4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404072:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a60d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404092:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a60d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404104:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a60d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404118:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a60de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404155:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a60de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404162:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a60de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404389:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404399:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404407:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211794.404453:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788211794.404458:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211794.404478:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404490:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404498:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a60d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404506:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a60d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404512:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a60d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404528:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211794.404533:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a60d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404540:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a60d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404553:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211794.404556:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211794.404561:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a60d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404567:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6800/0x2afbce82f55a60d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404583:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a60de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404590:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a60de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404596:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a60de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404601:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211794.404604:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a60de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404610:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a60de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404626:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc9a0d700) 00010000:00010000:2.0:1788211794.404628:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211794.404632:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a60de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404637:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a60de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404672:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a60d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aa4 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404686:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aa4 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211794.404694:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211794.404697:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211794.404700:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6c00, rc 0) 00000100:00100000:2.0:1788211794.404796:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:11524:x1875075637784576:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1085us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211794.404805:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 170 00010000:00010000:0.0:1788211795.109403:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788211795.242105:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788211795.242127:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788211795.242221:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788211795.242230:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788211795.242404:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1875075660852352:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788211795.242546:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd2b0ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788211795.251798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211795.251860:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637784704 00000100:00100000:1.0:1788211795.251871:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637784704 00000100:00100000:2.0:1788211795.251902:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1875075660852352:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788211795.251951:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 171 00000100:00100000:1.0:1788211795.251965:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:11535:x1875075637784704:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788211795.252007:0:6717:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788211795.252147:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:11535:x1875075637784704:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 184us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211795.252155:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 171 00000001:00080000:2.0:1788211795.256626:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000001:00080000:2.0:1788211795.256687:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:2.0:1788211795.257056:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:2.0:1788211795.257086:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788211795.257113:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8abfef9bf9c0 refcount 2 committed 0 result 0 batchid 5 00000100:00100000:3.0:1788211795.257329:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660852480:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788211795.257401:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788211795.257486:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ac00137b900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8abfef9bff00 00000020:00080000:2.0:1788211795.257504:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ac00137b300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8abffdf36c00 00000100:00100000:2.0:1788211795.257547:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660852480 00000100:00100000:2.0:1788211795.257554:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660852480 00000100:00100000:2.0:1788211795.257613:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788211795.257622:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660852480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788211795.257646:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1788211795.257682:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a95f250, atime: 0x0, ctime: 0x6a95f250, blocks: 0xb 00010000:00010000:2.0:1788211795.257691:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046c030c0/0x2afbce82f55a60ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.257717:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788211795.257721:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211795.257728:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046c030c0/0x2afbce82f55a60ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.257746:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046c030c0/0x2afbce82f55a60ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.257757:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046c030c0/0x2afbce82f55a60ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.257765:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046c030c0/0x2afbce82f55a60ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.259247:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1788211795.260245:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788211795.260405:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788211795.261573:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1788211795.262071:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788211795.262082:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046c030c0/0x2afbce82f55a60ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.262096:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788211795.262102:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046c030c0/0x2afbce82f55a60ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211795.262223:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637784832 00000100:00100000:0.0:1788211795.262233:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637784832 00000100:00100000:0.0:1788211795.262292:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 172 00000100:00100000:0.0:1788211795.262302:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:11535:x1875075637784832:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788211795.262378:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a60f3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262394:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a60f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262427:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a60f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262443:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a60fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262449:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a60fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262456:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a60fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262486:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a6101 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262496:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a6101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262503:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a6101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211795.262548:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788211795.262553:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788211795.262567:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a6101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262578:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a60f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262584:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a60f3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262600:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a60f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262604:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cca00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211795.262608:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a60f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262615:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a60f3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262629:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfc9a0db00) 00010000:00010000:0.0:1788211795.262633:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211795.262638:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a60f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262644:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a60f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262659:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a60fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262665:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a60fa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262671:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a60fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262675:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cdc00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211795.262678:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a60fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.262693:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a60fa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.263030:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046c030c0/0x2afbce82f55a60ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.263048:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046c030c0/0x2afbce82f55a60ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.263056:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046c030c0/0x2afbce82f55a60ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.263076:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211795.263078:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211795.263080:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211795.263434:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875075660852480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5809us (6029us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788211795.263453:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788211795.263484:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788211795.263525:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788211795.263531:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788211795.263563:0:3309:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8abfef8a2680 x1875075660852480/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788211811 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788211795.263574:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abfef8a2680/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788211795.263579:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660852480:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788211795.264493:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8abfdb434900) 00010000:00010000:0.0:1788211795.264497:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211795.264503:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a60fa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.264510:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a60fa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.264530:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a6101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.264536:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a6101 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.264542:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a6101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.264548:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211795.264550:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a6101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.264556:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a6101 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.264563:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:0.0:1788211795.264565:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211795.264567:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a6101 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.264584:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a6101 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211795.264666:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:11535:x1875075637784832:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 Request processed in 2362us (3097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211795.264677:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 172 00000100:00100000:1.0:1788211795.276378:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211795.282449:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637785088 00000100:00100000:3.0:1788211795.282475:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637785088 00000100:00100000:3.0:1788211795.282581:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 173 00000100:00100000:3.0:1788211795.282598:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+16:11535:x1875075637785088:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788211795.282629:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211795.282659:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a6108 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5aab expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.282836:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a610f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.282867:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a610f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.282882:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a610f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211795.282896:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788211795.283213:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a610f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.283222:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a610f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.283230:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a610f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.283237:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211795.283242:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a610f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.283250:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a610f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.283266:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:3.0:1788211795.283270:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788211795.283276:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a610f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.283294:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a610f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.283345:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a6108 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aab expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.283357:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfc9a0db00) 00010000:00010000:3.0:1788211795.283359:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788211795.283364:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a6108 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aab expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.283375:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062400, rc 0) 00000100:00100000:3.0:1788211795.283454:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:11535:x1875075637785088:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 861us (7086us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1788211795.283463:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 173 00000100:00100000:2.0:1788211795.286202:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211795.286322:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637785216 00000100:00100000:3.0:1788211795.286332:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637785216 00000100:00100000:3.0:1788211795.286394:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 174 00000100:00100000:3.0:1788211795.286406:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:11535:x1875075637785216:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788211795.286445:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788211795.286559:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:11535:x1875075637785216:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 155us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211795.286567:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 174 00000100:00100000:0.0:1788211795.290299:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211795.290380:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637785472 00000100:00100000:1.0:1788211795.290390:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637785472 00000100:00100000:1.0:1788211795.290456:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 175 00000100:00100000:1.0:1788211795.290467:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:11535:x1875075637785472:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788211795.290499:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211795.290503:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788211795.290532:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a60c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a9d expref: 17 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.290551:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:1.0:1788211795.290555:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788211795.290571:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a611d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ab2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788211795.291435:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788211795.291720:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a6124 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.291736:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a6124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.291747:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a6124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.291817:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a611d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ab2 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.291834:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a6124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ab2 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.291842:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfc37ece00) 00010000:00010000:1.0:1788211795.291845:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788211795.291856:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37aa00, rc 0) 00000100:00100000:1.0:1788211795.291940:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:11535:x1875075637785472:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1474us (1648us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788211795.291951:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 175 00000100:00100000:0.0:1788211795.298887:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211795.303279:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637785728 00000100:00100000:1.0:1788211795.303293:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637785728 00000100:00100000:1.0:1788211795.303370:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 176 00000100:00100000:1.0:1788211795.303382:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:11535:x1875075637785728:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788211795.303455:0:6717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211795.303484:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a6124 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ab2 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.303508:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfc37ece00) 00010000:00010000:1.0:1788211795.303521:0:6717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788211795.303550:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6132 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.303565:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6132 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.303576:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6132 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.303594:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6139 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbfb572ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.303600:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbfb572ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.303605:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbfb572ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.305933:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6132 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.305950:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6132 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.305958:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6132 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.305965:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ba00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211795.305970:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6132 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.305979:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6132 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.305998:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:1.0:1788211795.306001:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211795.306006:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6132 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.306012:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6132 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.306027:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbfb572ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.306033:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6139 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbfb572ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.306039:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6139 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbfb572ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.306051:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211795.306054:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6139 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbfb572ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.306059:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6139 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbfb572ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.306068:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbfb572ed (ffff8abfc37ec300) 00010000:00010000:1.0:1788211795.306071:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211795.306074:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6139 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbfb572ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.306080:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6139 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbfb572ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211795.306236:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:11535:x1875075637785728:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 2849us (7356us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788211795.306247:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 176 00000100:00100000:1.0:1788211795.313051:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211795.313258:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637785856 00000100:00100000:0.0:1788211795.313268:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637785856 00000100:00100000:0.0:1788211795.313330:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 177 00000100:00100000:0.0:1788211795.313341:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:11535:x1875075637785856:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788211795.313361:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211795.313384:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a6140 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ab9 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.313423:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a6147 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.313437:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a6147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.313449:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a6147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.313550:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a6140 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ab9 expref: 19 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.313580:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a6147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ab9 expref: 18 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.313588:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfdb434900) 00010000:00010000:0.0:1788211795.313591:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788211795.313594:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cca00, rc 0) 00000100:00100000:0.0:1788211795.313653:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:11535:x1875075637785856:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 314us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211795.313661:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 177 00000100:00100000:0.0:1788211795.316606:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211795.318023:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637786112 00000100:00100000:3.0:1788211795.318037:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637786112 00000100:00100000:1.0:1788211795.324192:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 178 00000100:00100000:1.0:1788211795.324210:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:11535:x1875075637786112:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788211795.324315:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a614e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.324332:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a614e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.324345:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a614e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788211795.324677:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788211795.324688:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384630520483ns, next at 385630517631ns, rc = 0 00000004:00010000:1.0:1788211795.324790:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdb9202b reply state 00000000bb1981db transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a614e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211795.324800:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788211795.324910:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:11535:x1875075637786112:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 703us (8311us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788211795.324919:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 178 00000100:00100000:0.0:1788211795.333393:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1788211795.333844:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a614e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.333883:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a614e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.333892:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a614e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.333898:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211795.333903:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a614e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.333912:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a614e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.333933:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfdb434900) 00010000:00010000:3.0:1788211795.333937:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788211795.333943:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a614e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.333950:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a614e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211795.334431:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637786240 00000100:00100000:1.0:1788211795.334446:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637786240 00000100:00100000:1.0:1788211795.334511:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 179 00000100:00100000:1.0:1788211795.334523:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:11535:x1875075637786240:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788211795.334550:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211795.334570:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6155 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ac0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.334634:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6155 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ac0 expref: 20 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.334648:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6155 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ac0 expref: 20 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.334667:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfdb434900) 00010000:00010000:1.0:1788211795.334669:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788211795.334672:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b400, rc 0) 00000100:00100000:1.0:1788211795.334756:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:11535:x1875075637786240:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 234us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211795.334763:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 179 00000100:00100000:1.0:1788211795.337254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211795.337433:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637786368 00000100:00100000:3.0:1788211795.337444:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637786368 00000100:00100000:3.0:1788211795.337515:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:3.0:1788211795.337526:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2358:x1875075637786368:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788211795.337948:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2358:x1875075637786368:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 423us (701us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788211795.337957:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00080000:0.0:1788211795.338592:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788211795.341342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211795.346144:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637786624 00000100:00100000:1.0:1788211795.346163:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637786624 00000100:00100000:1.0:1788211795.346258:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:1.0:1788211795.346269:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:11535:x1875075637786624:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788211795.346605:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:11535:x1875075637786624:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 337us (5275us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788211795.346615:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:3.0:1788211795.352059:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211795.352333:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637786880 00000100:00100000:1.0:1788211795.352345:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637786880 00000100:00100000:1.0:1788211795.352414:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 180 00000100:00100000:1.0:1788211795.352425:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:11535:x1875075637786880:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788211795.352560:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:11535:x1875075637786880:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 137us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211795.352568:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 180 00000100:00100000:1.0:1788211795.355640:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211795.355726:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637787008 00000100:00100000:2.0:1788211795.355738:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637787008 00000100:00100000:2.0:1788211795.355798:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 181 00000100:00100000:2.0:1788211795.355811:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:11535:x1875075637787008:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211795.355836:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211795.355870:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a615c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ac7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.355959:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a6163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.355976:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a6163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.355990:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a6163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211795.356037:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211795.356060:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a6163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.356109:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a615c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ac7 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.356142:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a6163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ac7 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.356150:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfdb434900) 00010000:00010000:2.0:1788211795.356153:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788211795.356156:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7000, rc 0) 00000100:00100000:2.0:1788211795.356360:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:11535:x1875075637787008:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 551us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211795.356369:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 181 00000100:00100000:0.0:1788211795.367057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211795.367205:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637787136 00000100:00100000:1.0:1788211795.367217:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637787136 00000100:00100000:1.0:1788211795.367276:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:1.0:1788211795.367287:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637787136:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788211795.367308:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211795.367335:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a616a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ace expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788211795.367387:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95f252, blocks: 0x1 00010000:00010000:1.0:1788211795.367408:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1788211795.367414:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211795.367424:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a616a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ace expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.367442:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a616a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ace expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.367456:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37ba00, rc 0) 00000100:00100000:1.0:1788211795.367515:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637787136:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 229us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211795.367522:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:3.0:1788211795.372676:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211795.372771:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637787392 00000100:00100000:2.0:1788211795.372783:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637787392 00000100:00100000:2.0:1788211795.372850:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 182 00000100:00100000:2.0:1788211795.372872:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:11535:x1875075637787392:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788211795.373027:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:11535:x1875075637787392:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 157us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211795.373035:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 182 00000100:00100000:0.0:1788211795.388066:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211795.389029:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637787520 00000100:00100000:3.0:1788211795.389046:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637787520 00000100:00100000:3.0:1788211795.389136:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:3.0:1788211795.389151:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:11535:x1875075637787520:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788211795.389198:0:8290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211795.389224:0:8290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ad5 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.389271:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a616a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ace expref: 9 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.389282:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211795.389287:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211795.389294:0:8290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ad5 expref: 9 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.389338:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a616a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ace expref: 9 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.389355:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a616a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ace expref: 9 pid: 6693 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211795.389372:0:8290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8290:1875075660852608:192.168.204.29@tcp:104: 00000100:00100000:3.0:1788211795.389482:0:8290:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd2b0eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788211795.392353:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211795.392448:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637787648 00000100:00100000:3.0:1788211795.392460:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637787648 00010000:00010000:3.0:1788211795.392504:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a616a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ace expref: 10 pid: 6693 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211795.392545:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:3.0:1788211795.392556:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:2358:x1875075637787648:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211795.392574:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211795.392605:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a616a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ace expref: 10 pid: 6693 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.392620:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a616a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ace expref: 10 pid: 6693 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.392657:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211795.392663:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211795.392673:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ad5 expref: 10 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.392683:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ad5 expref: 10 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.392745:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ad5 expref: 10 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211795.392760:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca8c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1875075660852736:192.168.204.29@tcp:105: 00000040:00080000:2.0:1788211795.398644:0:12524:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788211795.398654:0:12524:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788211795.398690:0:12524:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788211795.398708:0:12524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788211795.401398:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd2b0e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211795.404343:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca8c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1875075660852736:192.168.204.29@tcp:105: 00010000:00010000:3.0:1788211795.404378:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211795.404466:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:2358:x1875075637787648:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 11909us (12121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211795.404479:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 68 00010000:00010000:2.0:1788211795.408297:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a616a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ace expref: 9 pid: 6693 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211795.408356:0:8290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8290:1875075660852608:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211795.408408:0:8290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ad5 expref: 8 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.408431:0:8290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062400, rc 0) 00000100:00100000:2.0:1788211795.408531:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:11535:x1875075637787520:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 19381us (20478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211795.408542:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:3.0:1788211795.413094:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211795.414343:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637787776 00000100:00100000:0.0:1788211795.414357:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637787776 00002000:00100000:0.0:1788211795.414419:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8abfca8c9180 x1875075637787776/t0(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:346/0 lens 504/0 e 0 to 0 dl 1788211806 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788211795.414431:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abfca8c9180 with x1875075637787776 ext(0->8) 00002000:00010000:0.0:1788211795.414436:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8abfca8c9180 00000100:00100000:0.0:1788211795.414479:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:0.0:1788211795.414489:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2360:x1875075637787776:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788211795.415350:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:2360:x1875075637787776:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 Request processed in 856us (2261us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788211795.415368:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00002000:00100000:0.0:1788211795.415380:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8abfca8c9180 x1875075637787776/t4294967314(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:346/0 lens 504/448 e 0 to 0 dl 1788211806 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788211795.415389:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abfca8c9180 with x1875075637787776 ext(0->8) 00002000:00010000:0.0:1788211795.415394:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8abfca8c9180 00000100:00100000:3.0:1788211795.418377:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211795.418480:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637787904 00000100:00100000:2.0:1788211795.418490:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637787904 00000100:00100000:2.0:1788211795.418569:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 183 00000100:00100000:2.0:1788211795.418582:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:11535:x1875075637787904:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788211795.503759:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:11535:x1875075637787904:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 Request processed in 85164us (85382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211795.503776:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 183 00000001:00080000:2.0:1788211795.503823:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:2.0:1788211795.503835:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788211795.503883:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1788211795.504524:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788211795.504545:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660852864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788211795.504612:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211795.506640:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660852864 00000100:00100000:1.0:1788211795.506653:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660852864 00000100:00100000:1.0:1788211795.506739:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788211795.506749:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660852864:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788211795.506809:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788211795.506924:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788211795.506927:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788211794 00002000:00010000:1.0:1788211795.506930:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788211795.506932:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788211794 -> 1788211794 00002000:00010000:1.0:1788211795.506934:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788211795.507011:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875075660852864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 263us (2401us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788211795.507017:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:2.0:1788211795.507191:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abffe055180/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788211795.507199:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660852864:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1788211795.507237:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788211795.507248:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788211795.510960:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211795.511099:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637788032 00000100:00100000:1.0:1788211795.511110:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637788032 00000100:00100000:1.0:1788211795.511183:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:1.0:1788211795.511195:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:2358:x1875075637788032:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788211795.545357:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1788211795.545389:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1788211795.545463:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2358:x1875075637788032:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 Request processed in 34263us (34505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211795.545475:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:3.0:1788211795.552333:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211795.552434:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637788288 00000100:00100000:1.0:1788211795.552445:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637788288 00000100:00100000:1.0:1788211795.552511:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 184 00000100:00100000:1.0:1788211795.552523:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:11535:x1875075637788288:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788211795.552650:0:6717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211795.552678:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a6163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ac7 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.552711:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfdb434900) 00010000:00010000:1.0:1788211795.552716:0:6717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788211795.552749:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6178 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.552762:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.552781:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788211795.553501:0:6717:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea19cab9 reply state 00000000a28ca38b transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211795.553523:0:6717:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788211795.553657:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:11535:x1875075637788288:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 1135us (1332us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1788211795.553667:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 184 00010000:00010000:3.0:1788211795.561307:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.561328:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6178 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.561337:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6178 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.561344:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211795.561350:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6178 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.561359:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6178 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.561381:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfdb434900) 00010000:00010000:3.0:1788211795.561393:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211795.561401:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6178 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.561409:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6178 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211795.561814:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211795.562360:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637788416 00000100:00100000:3.0:1788211795.562373:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637788416 00000100:00100000:3.0:1788211795.562452:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:3.0:1788211795.562464:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637788416:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788211795.562773:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788211795.562777:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788211794 -> 1788211793 00002000:00010000:3.0:1788211795.562780:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788211792 00002000:00010000:3.0:1788211795.562783:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788211794 -> 1788211793 00002000:00010000:3.0:1788211795.562786:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788211795.562883:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637788416:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 419us (1076us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788211795.562892:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:1.0:1788211795.567485:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211795.567535:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637788672 00000100:00100000:3.0:1788211795.567547:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637788672 00000100:00100000:3.0:1788211795.567609:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 185 00000100:00100000:3.0:1788211795.567619:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:11535:x1875075637788672:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788211795.567719:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.567740:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a6147 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ab9 expref: 18 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.567760:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.567799:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a6147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ab9 expref: 18 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.567813:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a6147 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ab9 expref: 18 pid: 9952 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211795.567830:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875075660852992:192.168.204.29@tcp:104: 00000100:00100000:3.0:1788211795.567958:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd2b0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211795.587464:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211795.587503:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637788800 00000100:00100000:2.0:1788211795.587513:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637788800 00000100:00100000:3.0:1788211795.587568:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875075660852992:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211795.587611:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.589048:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a6147 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ab9 expref: 19 pid: 9952 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211795.589105:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:2.0:1788211795.589119:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:2359:x1875075637788800:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211795.589136:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211795.589145:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a6147 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ab9 expref: 19 pid: 9952 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.589160:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a6147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ab9 expref: 19 pid: 9952 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.589400:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a6147 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ab9 expref: 19 pid: 9952 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.589420:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfdb434900) 00010000:00010000:2.0:1788211795.589427:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.589438:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.589447:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.589497:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211795.589863:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:2359:x1875075637788800:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 746us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211795.589872:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 69 00010000:00010000:2.0:1788211795.590271:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.590282:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.590325:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.590334:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.590341:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.590348:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211795.590354:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.590363:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.590376:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfdb434900) 00010000:00010000:2.0:1788211795.590380:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788211795.590383:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.590404:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a617f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211795.590474:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:11535:x1875075637788672:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 Request processed in 22854us (22997us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788211795.590483:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 185 00000100:00100000:3.0:1788211795.598977:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211795.599038:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637788928 00000100:00100000:0.0:1788211795.599049:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637788928 00000100:00100000:0.0:1788211795.599123:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 58 00000100:00100000:0.0:1788211795.599136:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637788928:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788211795.599210:0:8290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.599234:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ad5 expref: 8 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.599243:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211795.599249:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788211795.599254:0:8290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.599293:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ad5 expref: 8 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.599312:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ad5 expref: 8 pid: 8290 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211795.599354:0:8290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8290:1875075660853120:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211795.599457:0:8290:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd879d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788211795.605329:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211795.605366:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637789056 00000100:00100000:3.0:1788211795.605375:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637789056 00010000:00010000:3.0:1788211795.605418:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ad5 expref: 9 pid: 8290 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211795.605461:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:3.0:1788211795.605473:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2359:x1875075637789056:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211795.605487:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211795.605521:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ad5 expref: 9 pid: 8290 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.605536:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ad5 expref: 9 pid: 8290 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.605563:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788211795.605568:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788211795.605574:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.605586:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.605609:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211795.605663:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2359:x1875075637789056:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 193us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211795.605672:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 70 00010000:00010000:0.0:1788211795.607288:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6171 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ad5 expref: 8 pid: 8290 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211795.607316:0:8290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8290:1875075660853120:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211795.607344:0:8290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.607357:0:8290:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.607366:0:8290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.607405:0:8290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.607415:0:8290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.607425:0:8290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.607454:0:8290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211795.607459:0:8290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.607470:0:8290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.607489:0:8290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.607498:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6186 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211795.607638:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637788928:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 Request processed in 8504us (8670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211795.607651:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 58 00000100:00100000:3.0:1788211795.611550:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211795.611766:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637789312 00000100:00100000:2.0:1788211795.611777:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637789312 00000100:00100000:2.0:1788211795.611896:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 186 00000100:00100000:2.0:1788211795.611908:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+17:11535:x1875075637789312:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788211795.612012:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a618d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.612032:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a618d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.612045:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a618d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.612332:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.612344:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6155 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ac0 expref: 18 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.612353:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.612389:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6155 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ac0 expref: 18 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.612418:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6155 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ac0 expref: 18 pid: 6717 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211795.612434:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe056a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660853248:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211795.612557:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788211795.619301:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe056a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660853248:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211795.619335:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211795.619634:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211795.619725:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637789440 00000100:00100000:2.0:1788211795.619735:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637789440 00010000:00010000:2.0:1788211795.619772:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6155 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ac0 expref: 19 pid: 6717 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211795.619857:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00100000:2.0:1788211795.619869:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:2358:x1875075637789440:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211795.619886:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211795.619894:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6155 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ac0 expref: 19 pid: 6717 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.619908:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6155 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ac0 expref: 19 pid: 6717 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.619932:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a6155 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ac0 expref: 19 pid: 6717 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.619974:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfdb434900) 00010000:00010000:2.0:1788211795.619980:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.619990:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.619999:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.620033:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211795.620110:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:2358:x1875075637789440:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 242us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211795.620128:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 71 00010000:00010000:0.0:1788211795.620203:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.620212:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788211795.620467:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788211795.620634:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1788211795.620683:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788211795.620796:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875075660853376:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788211795.620870:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211795.620913:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd879d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788211795.621334:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660853376 00000100:00100000:1.0:1788211795.621343:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660853376 00000100:00100000:1.0:1788211795.621427:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788211795.621443:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875075660853376:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788211795.621587:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875075660853376:12345-0@lo:1000:mdt00_000.0 Request processed in 128us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211795.621603:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788211795.621637:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788211795.621644:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abffe055180, transno 4294967315 00000100:00100000:0.0:1788211795.621663:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875075660853376:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788211795.622273:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1788211795.622364:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875075660853504:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788211795.622422:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211795.622441:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd879d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788211795.622798:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660853504 00000100:00100000:1.0:1788211795.622806:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660853504 00000100:00100000:1.0:1788211795.622844:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788211795.622853:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875075660853504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788211795.623221:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875075660853504:12345-0@lo:1000:mdt00_000.0 Request processed in 368us (797us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788211795.623231:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788211795.623697:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875075660853504:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788211795.623740:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.623751:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.623759:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.623774:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7a00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211795.623778:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.623787:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.623803:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfdb434900) 00010000:00010000:3.0:1788211795.623806:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788211795.623811:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.623818:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7a00/0x2afbce82f55a6194 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.624097:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.624281:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.624291:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.624297:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211795.624301:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.624308:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.624332:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:3.0:1788211795.624335:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788211795.624339:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211795.624346:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a60c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.624442:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.624460:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aa4 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.624469:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.624505:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aa4 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.624520:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aa4 expref: 21 pid: 5843 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211795.624550:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe055180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660853632:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211795.624672:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788211795.628218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211795.628319:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe055180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660853632:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211795.628346:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211795.631103:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637789568 00000100:00100000:1.0:1788211795.631121:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637789568 00010000:00010000:1.0:1788211795.631211:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aa4 expref: 22 pid: 5843 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211795.631251:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 72 00000100:00100000:1.0:1788211795.631277:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:2358:x1875075637789568:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211795.631293:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211795.631301:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aa4 expref: 22 pid: 5843 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.631315:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aa4 expref: 22 pid: 5843 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.631341:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a60e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aa4 expref: 22 pid: 5843 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.631362:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:1.0:1788211795.631367:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.631378:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.631386:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211795.631427:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211795.631442:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631454:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631469:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631477:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631484:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631491:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211795.631497:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631505:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631517:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211795.631524:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211795.631529:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631536:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a619b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631557:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a618d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631565:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a618d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631571:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a618d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631576:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211795.631579:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a618d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631585:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a618d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631594:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211795.631597:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788211795.631600:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a618d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.631606:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a618d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211795.632033:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:11535:x1875075637789312:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 20125us (20491us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1788211795.632046:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 186 00000020:00080000:2.0:1788211795.632053:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788211795.632091:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:2358:x1875075637789568:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 818us (3884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211795.632109:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 72 00000040:00080000:3.0:1788211795.632473:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788211795.632480:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788211795.636729:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788211795.636753:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788211795.637862:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211795.638606:0:12483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637789824 00000100:00100000:3.0:1788211795.638624:0:12483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637789824 00000100:00100000:2.0:1788211795.638945:0:12483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:2.0:1788211795.639017:0:12483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc64f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:11535:x1875075637789824:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788211795.640111:0:12483:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788211795.640348:0:12483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1788211795.640420:0:12483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a61a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.640445:0:12483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a61a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.640459:0:12483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a61a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.640468:0:12483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a61a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.640476:0:12483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a61a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.640483:0:12483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a61a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211795.640580:0:12483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788211795.640709:0:12483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc64f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:11535:x1875075637789824:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 1751us (2859us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788211795.640718:0:12483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 50 00000020:00080000:2.0:1788211795.640724:0:12483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788211795.643504:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211795.643523:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a61a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.643538:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211795.643543:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a61a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.643554:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a61a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.643575:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8abfc9a0df00) 00010000:00010000:0.0:1788211795.643578:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788211795.643583:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a61a2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.643615:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a61a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211795.643646:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211795.643648:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211795.643650:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211796.133587:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211796.711218:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788211796.711244:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660853760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211796.711320:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211796.712194:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660853760 00000100:00100000:0.0:1788211796.712207:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660853760 00000100:00100000:0.0:1788211796.712261:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788211796.712273:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660853760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788211796.712319:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211796.712407:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660853760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211796.712415:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788211796.712472:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660853760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788211797.160257:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211797.227045:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660853888:0@lo:400:kworker.0 00000100:00100000:2.0:1788211797.227121:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211797.227193:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660854400:0@lo:400:kworker.0 00000100:00100000:2.0:1788211797.227225:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211797.227262:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211797.227268:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660854016:0@lo:400:kworker.0 00000100:00100000:2.0:1788211797.227294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211797.227326:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00132b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660854144:0@lo:400:kworker.0 00000100:00100000:2.0:1788211797.227352:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211797.227369:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788211797.227374:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00132b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660854272:0@lo:400:kworker.0 00000100:00100000:2.0:1788211797.227394:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211797.227685:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660853888 00000100:00100000:2.0:1788211797.227694:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660853888 00000100:00100000:2.0:1788211797.227740:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788211797.227749:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660853888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211797.227829:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660853888:12345-0@lo:400:kworker.0 Request processed in 77us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211797.227841:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788211797.227894:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660854016 00000100:00100000:2.0:1788211797.227900:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660854016 00000100:00100000:2.0:1788211797.227941:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660854144 00000100:00100000:2.0:1788211797.227947:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660854144 00000100:00100000:2.0:1788211797.227991:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660854272 00000100:00100000:2.0:1788211797.227997:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660854272 00000100:00100000:2.0:1788211797.228022:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788211797.228033:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660854016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211797.228106:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660854016:12345-0@lo:400:kworker.0 Request processed in 76us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211797.228112:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788211797.228136:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788211797.228148:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660854144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211797.228223:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660854144:12345-0@lo:400:kworker.0 Request processed in 80us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211797.228229:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788211797.228240:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788211797.228246:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660854272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211797.228273:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660854272:12345-0@lo:400:kworker.0 Request processed in 27us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211797.228279:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:2.0:1788211797.228300:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211797.228332:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00132b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660854272:0@lo:400:kworker.0 00000100:00100000:2.0:1788211797.228342:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00132b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660854144:0@lo:400:kworker.0 00000100:00100000:2.0:1788211797.228373:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660854016:0@lo:400:kworker.0 00000100:00100000:2.0:1788211797.228380:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660853888:0@lo:400:kworker.0 00000100:00100000:1.0:1788211797.233096:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660854400 00000100:00100000:1.0:1788211797.233113:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660854400 00000100:00100000:1.0:1788211797.233222:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788211797.233247:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875075660854400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211797.233364:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875075660854400:12345-0@lo:400:kworker.0 Request processed in 118us (6134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211797.233376:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788211797.233455:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788211797.233507:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660854400:0@lo:400:kworker.0 00000040:00080000:3.0:1788211797.514761:0:12576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788211797.514775:0:12576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788211797.514817:0:12576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788211797.514829:0:12576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788211797.659234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211797.662374:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637790080 00000100:00100000:2.0:1788211797.662388:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637790080 00000100:00100000:2.0:1788211797.662480:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 187 00000100:00100000:2.0:1788211797.662492:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:11553:x1875075637790080:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211797.662517:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211797.662555:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a61a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5adc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788211797.662684:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788211797.663368:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a61b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.663385:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a61b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.663399:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a61b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211797.663412:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1788211797.664932:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a61a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5adc expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.664960:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a61b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5adc expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.664968:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211797.664971:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788211797.664975:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7200, rc 0) 00000100:00100000:2.0:1788211797.665363:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+24:11553:x1875075637790080:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2868us (6136us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788211797.665374:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 187 00000100:00100000:3.0:1788211797.678970:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211797.681696:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637790208 00000100:00100000:0.0:1788211797.681712:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637790208 00000100:00100000:0.0:1788211797.681847:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 188 00000100:00100000:0.0:1788211797.681869:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+24:11553:x1875075637790208:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1788211797.681999:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a61be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682024:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a61be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682038:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a61be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682091:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682102:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682109:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682551:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a61cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682561:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a61cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682568:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a61cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788211797.682619:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a61cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682632:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a61be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682638:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a61be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682645:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a61be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682663:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211797.682668:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a61be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682683:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a61be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682698:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:0.0:1788211797.682700:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211797.682705:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a61be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682711:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a61be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682724:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682729:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682734:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682739:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211797.682742:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682747:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682754:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfdb434f00) 00010000:00010000:0.0:1788211797.682756:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211797.682758:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682772:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682787:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a61cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682793:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a61cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682799:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a61cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682805:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cda00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211797.682807:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a61cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682814:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a61cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682822:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfdb434900) 00010000:00010000:0.0:1788211797.682824:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211797.682827:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a61cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.682832:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a61cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211797.682924:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+24:11553:x1875075637790208:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1062us (3965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211797.682934:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 188 00000100:00100000:1.0:1788211797.733437:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211797.733477:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00107d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660854528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211797.733598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211797.733959:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660854528 00000100:00100000:2.0:1788211797.733975:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660854528 00000100:00100000:2.0:1788211797.734082:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788211797.734098:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875075660854528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211797.734139:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211797.734254:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875075660854528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211797.734267:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788211797.734852:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00107d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660854528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211797.758704:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211797.758938:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637790464 00000100:00100000:3.0:1788211797.758954:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637790464 00000100:00100000:3.0:1788211797.759057:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 189 00000100:00100000:3.0:1788211797.759074:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+24:11556:x1875075637790464:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211797.759100:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211797.759120:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a61d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ae3 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.759290:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a61da lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.759333:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a61da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.759358:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a61da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.759391:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a61e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.759403:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a61e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.759414:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a61e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760483:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a61e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760496:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a61e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760506:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a61e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211797.760521:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788211797.760827:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a61da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760836:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a61da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760843:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a61da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760858:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211797.760862:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a61da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760870:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a61da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760884:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:3.0:1788211797.760888:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211797.760892:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a61da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760898:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a61da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760910:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a61e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760916:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a61e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760923:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a61e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760928:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211797.760931:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a61e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760936:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a61e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760953:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc5bbea00) 00010000:00010000:3.0:1788211797.760955:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211797.760958:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a61e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.760964:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062400/0x2afbce82f55a61e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.761012:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a61d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ae3 expref: 27 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.761026:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a61e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ae3 expref: 26 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.761033:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:3.0:1788211797.761035:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211797.761038:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063000, rc 0) 00000100:00100000:3.0:1788211797.761115:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:11556:x1875075637790464:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2046us (2420us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788211797.761124:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 189 00000100:00100000:1.0:1788211797.780341:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211797.780479:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637790592 00000100:00100000:0.0:1788211797.780489:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637790592 00000100:00100000:0.0:1788211797.780644:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 190 00000100:00100000:0.0:1788211797.780665:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:11556:x1875075637790592:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:0.0:1788211797.780750:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.780768:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.780780:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.780809:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.780816:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.780824:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.780830:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211797.780834:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.780842:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.780855:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:0.0:1788211797.780858:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788211797.780997:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.781013:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a61f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211797.781129:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:11556:x1875075637790592:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 465us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211797.781137:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 190 00000100:00100000:0.0:1788211797.786285:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211797.786429:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637790848 00000100:00100000:1.0:1788211797.786439:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637790848 00000100:00100000:1.0:1788211797.786493:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:1.0:1788211797.786504:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:11556:x1875075637790848:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1788211797.786780:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+27:11556:x1875075637790848:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 276us (505us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788211797.786789:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:1.0:1788211797.841352:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211797.844438:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637791104 00000100:00100000:0.0:1788211797.844457:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637791104 00000100:00100000:1.0:1788211797.844592:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 191 00000100:00100000:1.0:1788211797.844612:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+27:11081:x1875075637791104:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788211797.844636:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211797.844666:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a61fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5aea expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211797.844815:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211797.844844:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a61e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ae3 expref: 28 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211797.844852:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211797.844893:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a61e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ae3 expref: 28 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211797.844909:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a61e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ae3 expref: 28 pid: 6717 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211797.844923:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660854656:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211797.845195:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788211797.851060:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211797.851141:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637791232 00000100:00100000:0.0:1788211797.851153:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637791232 00010000:00010000:0.0:1788211797.851212:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a61e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ae3 expref: 29 pid: 6717 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211797.851248:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:0.0:1788211797.851258:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+29:2359:x1875075637791232:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788211797.851274:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211797.851281:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a61e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ae3 expref: 29 pid: 6717 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.851295:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a61e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ae3 expref: 29 pid: 6717 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.851316:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:0.0:1788211797.851322:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.851347:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.851354:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.851375:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211797.851433:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+29:2359:x1875075637791232:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 175us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211797.851440:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 73 00010000:00010000:2.0:1788211797.852147:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a61e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ae3 expref: 28 pid: 6717 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211797.852224:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660854656:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211797.852249:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.852257:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.852263:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211797.852285:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788211797.852458:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a61fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aea expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.852473:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aea expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.852480:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:2.0:1788211797.852483:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788211797.852486:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37ba00, rc 0) 00000100:00100000:2.0:1788211797.852572:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:11081:x1875075637791104:12345-192.168.204.29@tcp:101:bash.0 Request processed in 7970us (11230us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788211797.852579:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 191 00000100:00100000:1.0:1788211797.864383:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211797.864474:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637791488 00000100:00100000:3.0:1788211797.864486:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637791488 00000100:00100000:3.0:1788211797.864549:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 192 00000100:00100000:3.0:1788211797.864560:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:11081:x1875075637791488:12345-192.168.204.29@tcp:36:bash.0 00010000:00010000:3.0:1788211797.865094:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6212 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.865111:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.865137:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788211797.865879:0:6717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1788211797.865924:0:6717:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d569f50d reply state 0000000066b5520f transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211797.865934:0:6717:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788211797.866873:0:6717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:2.0:1788211797.869065:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+32:11081:x1875075637791488:12345-192.168.204.29@tcp:36:bash.0 Request processed in 4483us (4667us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788211797.869080:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 192 00000020:00080000:2.0:1788211797.869089:0:6717:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788211797.871582:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.871679:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6212 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.871690:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6212 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.871696:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211797.871701:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6212 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.871709:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6212 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.871858:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:3.0:1788211797.871862:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211797.871867:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6212 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.871874:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6212 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211797.872947:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211797.873406:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637791616 00000100:00100000:0.0:1788211797.873416:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637791616 00000100:00100000:0.0:1788211797.873480:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 193 00000100:00100000:0.0:1788211797.873491:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:11081:x1875075637791616:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1788211797.873517:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211797.873538:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6219 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5af1 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.873623:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6219 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5af1 expref: 32 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.873639:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6219 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5af1 expref: 32 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211797.873670:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:0.0:1788211797.873673:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788211797.873678:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd200, rc 0) 00000100:00100000:0.0:1788211797.873944:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+32:11081:x1875075637791616:12345-192.168.204.29@tcp:101:bash.0 Request processed in 454us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211797.873951:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 193 00000100:00100000:1.0:1788211797.878077:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211797.878156:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637791744 00000100:00100000:3.0:1788211797.878190:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637791744 00000100:00100000:3.0:1788211797.878269:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:3.0:1788211797.878292:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:11081:x1875075637791744:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:3.0:1788211797.878311:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211797.878331:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6220 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5af8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788211797.878361:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a95f251, atime: 0x6a95f250, ctime: 0x6a95f251, blocks: 0xb 00010000:00010000:3.0:1788211797.878383:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=387s v=(0 0) 00010000:00010000:3.0:1788211797.878390:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211797.878413:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6220 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5af8 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.878434:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6220 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5af8 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211797.878446:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062400, rc 0) 00000100:00100000:3.0:1788211797.878507:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:11081:x1875075637791744:12345-192.168.204.29@tcp:101:bash.0 Request processed in 228us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211797.878515:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00080000:0.0:1788211797.879202:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788211797.882912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211797.883213:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637791872 00000100:00100000:3.0:1788211797.883227:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637791872 00002000:00010000:3.0:1788211797.883289:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788211797.883295:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac00107d500 with x1875075637791872 ext(0->18446744073709551615) 00002000:00010000:3.0:1788211797.883575:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ac00107d500. 00000100:00100000:3.0:1788211797.883618:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:3.0:1788211797.883630:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637791872:12345-192.168.204.29@tcp:10:bash.0 00002000:00010000:3.0:1788211797.884973:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788211797.884981:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788211793 -> 1788211797 00002000:00010000:3.0:1788211797.884985:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788211792 -> 1788211792 00002000:00010000:3.0:1788211797.884987:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788211793 -> 1788211797 00002000:00010000:3.0:1788211797.884990:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788211797.885423:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2359:x1875075637791872:12345-192.168.204.29@tcp:10:bash.0 Request processed in 1512us (2237us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788211797.885503:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00002000:00010000:3.0:1788211797.885509:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788211797.885512:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac00107d500 with x1875075637791872 ext(0->18446744073709551615) 00002000:00010000:3.0:1788211797.885519:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ac00107d500. 00000100:00100000:1.0:1788211797.993128:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211797.993261:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637792000 00000100:00100000:2.0:1788211797.993273:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637792000 00000100:00100000:2.0:1788211797.993339:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 194 00000100:00100000:2.0:1788211797.993349:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+32:11570:x1875075637792000:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1788211797.993433:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6227 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993451:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6227 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993463:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6227 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993479:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a622e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993486:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a622e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993492:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a622e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993844:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993855:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993871:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788211797.993919:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993932:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6227 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993939:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6227 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993947:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6227 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993953:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211797.993959:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6227 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993966:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6227 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993982:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211797.993986:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211797.993990:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6227 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.993997:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a6227 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994011:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a622e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994023:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a622e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994029:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a622e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994034:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211797.994038:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a622e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994043:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a622e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994050:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211797.994053:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211797.994056:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a622e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994061:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a622e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994074:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994080:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6235 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994085:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994090:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211797.994098:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994104:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994111:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:2.0:1788211797.994113:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211797.994116:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6235 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211797.994122:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a6235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211797.994259:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+32:11570:x1875075637792000:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 910us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211797.994269:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 194 00000100:00100000:1.0:1788211798.062770:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211798.063006:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637792256 00000100:00100000:2.0:1788211798.063019:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637792256 00000100:00100000:2.0:1788211798.063095:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 195 00000100:00100000:2.0:1788211798.063107:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+32:11573:x1875075637792256:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211798.063131:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211798.063159:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a623c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5aff expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.063529:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6243 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.063548:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6243 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.063585:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6243 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.063603:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a624a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.063610:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a624a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.063617:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a624a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.064525:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a6251 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.064540:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a6251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.064550:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a6251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211798.064564:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788211798.065055:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6243 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065398:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6243 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065406:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6243 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065412:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211798.065428:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6243 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065436:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6243 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065451:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211798.065454:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211798.065459:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6243 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065465:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a6243 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065481:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a624a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065488:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a624a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065493:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a624a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065498:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211798.065501:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a624a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065506:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a624a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065512:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211798.065514:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211798.065524:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a624a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065530:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6400/0x2afbce82f55a624a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065586:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a623c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aff expref: 35 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065604:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a6251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aff expref: 34 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.065611:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:2.0:1788211798.065613:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788211798.065615:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7c00, rc 0) 00000100:00100000:2.0:1788211798.066163:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:11573:x1875075637792256:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3055us (3399us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788211798.066402:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 195 00000100:00100000:3.0:1788211798.070108:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211798.070219:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637792384 00000100:00100000:1.0:1788211798.070229:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637792384 00000100:00100000:1.0:1788211798.070296:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 196 00000100:00100000:1.0:1788211798.070307:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:11573:x1875075637792384:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:1.0:1788211798.070404:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.070420:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aea expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.070428:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.070460:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aea expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.070473:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aea expref: 34 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211798.070487:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875075660854784:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211798.070576:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788211798.079062:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211798.079631:0:12483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637792640 00000100:00100000:3.0:1788211798.079653:0:12483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637792640 00000100:00100000:3.0:1788211798.079722:0:12483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:3.0:1788211798.079734:0:12483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+35:5599:x1875075637792640:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788211798.080089:0:12483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+36:5599:x1875075637792640:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 356us (1041us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788211798.080097:0:12483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:2.0:1788211798.080603:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875075660854784:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211798.080634:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211798.083467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211798.083752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637792768 00000100:00100000:2.0:1788211798.083761:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637792768 00010000:00010000:2.0:1788211798.083815:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aea expref: 36 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211798.083871:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 74 00000100:00100000:2.0:1788211798.083882:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+36:2359:x1875075637792768:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211798.083917:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211798.083925:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aea expref: 36 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.083938:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aea expref: 36 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.083962:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6204 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aea expref: 36 pid: 5843 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.083983:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:2.0:1788211798.083988:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.083999:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.084006:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.084041:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211798.084101:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+35:2359:x1875075637792768:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 221us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211798.084109:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 74 00010000:00010000:3.0:1788211798.085668:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.085704:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.085741:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.085748:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.085754:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.085760:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211798.085764:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.085772:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.085786:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:3.0:1788211798.085789:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788211798.085794:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.085801:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a625f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211798.085916:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:11573:x1875075637792384:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 15607us (15813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211798.085926:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 196 00000100:00100000:3.0:1788211798.090484:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211798.090575:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637793024 00000100:00100000:1.0:1788211798.090585:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637793024 00000100:00100000:1.0:1788211798.090659:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:1.0:1788211798.090670:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+34:11573:x1875075637793024:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1788211798.091092:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+35:11573:x1875075637793024:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 423us (615us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788211798.091102:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00010000:00010000:1.0:1788211798.182757:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211798.209953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211798.211024:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637793280 00000100:00100000:1.0:1788211798.211133:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637793280 00000100:00100000:1.0:1788211798.211298:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 197 00000100:00100000:1.0:1788211798.211311:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+35:11584:x1875075637793280:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1788211798.211354:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211798.211385:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6266 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b06 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.211477:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a626d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.211491:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a626d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.211502:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a626d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.211519:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6274 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.211525:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.211531:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.211959:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a627b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.211969:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a627b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.211977:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a627b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211798.211994:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788211798.212104:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a626d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212111:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a626d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212116:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a626d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212122:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37aa00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211798.212126:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a626d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212133:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a626d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212144:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:1.0:1788211798.212147:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211798.212151:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a626d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212157:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a626d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212199:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212206:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6274 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212222:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212227:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ba00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211798.212230:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212237:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6274 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212246:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc37ecd00) 00010000:00010000:1.0:1788211798.212248:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211798.212250:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6274 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212255:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a6274 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212305:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a6266 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b06 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212320:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a627b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b06 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.212326:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:1.0:1788211798.212328:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788211798.212331:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37ae00, rc 0) 00000100:00100000:1.0:1788211798.212412:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+37:11584:x1875075637793280:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1102us (2473us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788211798.212429:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 197 00000100:00100000:2.0:1788211798.220660:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211798.220854:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637793536 00000100:00100000:1.0:1788211798.220868:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637793536 00000100:00100000:1.0:1788211798.220932:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:1.0:1788211798.220943:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+37:11584:x1875075637793536:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:1.0:1788211798.221537:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+38:11584:x1875075637793536:12345-192.168.204.29@tcp:35:cat.0 Request processed in 592us (902us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788211798.221547:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:3.0:1788211798.234119:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211798.234216:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211798.234445:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637793792 00000100:00100000:1.0:1788211798.234455:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637793792 00000100:00100000:1.0:1788211798.234517:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:1.0:1788211798.234529:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637793792:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211798.234611:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637793792:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 85us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211798.234619:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00080000:0.0:1788211798.234818:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788211798.235472:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637793664 00000100:00100000:2.0:1788211798.235480:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637793664 00000100:00100000:2.0:1788211798.235517:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 301 00000100:00100000:2.0:1788211798.235542:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637793664:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211798.235585:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637793664:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 46us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211798.235592:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 301 00000100:00100000:2.0:1788211798.238794:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211798.239529:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637793920 00000100:00100000:1.0:1788211798.239541:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637793920 00000100:00080000:0.0:1788211798.243666:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211798.243943:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 171 00000100:00100000:1.0:1788211798.243991:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637793920:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211798.244102:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637793920:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 136us (5328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211798.244110:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 171 00000100:00100000:3.0:1788211798.287650:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211798.287694:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637794176 00000100:00100000:3.0:1788211798.287705:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637794176 00000100:00100000:3.0:1788211798.287762:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 198 00000100:00100000:3.0:1788211798.287772:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+38:11585:x1875075637794176:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:3.0:1788211798.288084:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788211798.288112:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ae00/0x2afbce82f55a627b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b06 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.288138:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a6251 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5aff expref: 37 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.288152:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6219 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5af1 expref: 36 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.288163:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe100) 00010000:00010000:3.0:1788211798.288212:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788211798.288252:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6289 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.288270:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6289 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.288280:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6289 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.288316:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6290 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.288456:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6290 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.288464:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6290 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.289008:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a6297 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.289020:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a6297 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.289028:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a6297 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788211798.290118:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788211798.290131:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387595963573ns, next at 388595960943ns, rc = 0 00010000:00010000:3.0:1788211798.290296:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a629e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290309:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a629e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290389:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a629e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290400:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a629e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290417:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a629e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290422:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a629e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290444:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211798.290470:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a6297 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290477:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a6297 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290483:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a6297 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290488:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211798.290493:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a6297 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290500:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a6297 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290513:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe400) 00010000:00010000:3.0:1788211798.290517:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788211798.290521:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a6297 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290526:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a6297 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290547:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6289 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290559:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6289 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290565:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6289 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290570:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211798.290573:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6289 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290578:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6289 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290587:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:3.0:1788211798.290590:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211798.290593:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6289 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.290599:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6289 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788211798.290610:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a99b508d reply state 000000001e173a97 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6290 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211798.290619:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788211798.290870:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+37:11585:x1875075637794176:12345-192.168.204.29@tcp:36:rm.0 Request processed in 3094us (3243us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788211798.290881:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 198 00010000:00010000:0.0:1788211798.291146:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211798.291155:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a629e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.291162:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211798.291195:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a629e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.291204:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a629e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.291214:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8abfc5bbe400) 00010000:00010000:0.0:1788211798.291217:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788211798.291220:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a629e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.291235:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a629e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.291255:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211798.291257:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211798.291259:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211798.294487:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6290 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.294505:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6290 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.294526:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6290 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.294532:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211798.294536:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6290 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.294543:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6290 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.294560:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc5bbec00) 00010000:00010000:0.0:1788211798.294563:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211798.294568:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6290 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.294574:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6290 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788211798.342780:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:3.0:1788211798.374100:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211798.374421:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637794432 00000100:00100000:1.0:1788211798.374434:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637794432 00000100:00100000:1.0:1788211798.374507:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 199 00000100:00100000:1.0:1788211798.374539:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+36:11591:x1875075637794432:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788211798.374578:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211798.374604:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a62a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.374900:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a62ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.374918:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a62ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.374931:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a62ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.374949:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a62b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.374956:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a62b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.374964:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a62b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788211798.377310:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788211798.377575:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a62ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.377590:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a62ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.377602:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a62ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.377658:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a62ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.377666:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a62ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.377672:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a62ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.377678:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ba00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211798.377682:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a62ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.377760:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a62ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.377790:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211798.377793:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211798.377921:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a62ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.377929:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37ba00/0x2afbce82f55a62ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788211798.377947:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000722e762a reply state 0000000007c766b7 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a62b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211798.377957:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788211798.377998:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b200/0x2afbce82f55a62a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b0d expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.378013:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a62ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b0d expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.378020:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211798.378023:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211798.378025:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6200, rc 0) 00000100:00100000:2.0:1788211798.378285:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:11591:x1875075637794432:12345-192.168.204.29@tcp:101:bash.0 Request processed in 3749us (4201us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788211798.378294:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 199 00010000:00010000:2.0:1788211798.380719:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a62b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.380738:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a62b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.380766:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a62b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.380772:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37aa00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211798.380776:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a62b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.380784:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a62b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.380811:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc37ecd00) 00010000:00010000:2.0:1788211798.380815:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211798.380819:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a62b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.380825:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a62b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211798.384116:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211798.384561:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637794560 00000100:00100000:1.0:1788211798.384575:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637794560 00000100:00100000:1.0:1788211798.384823:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:1.0:1788211798.384838:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2361:x1875075637794560:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788211798.384863:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211798.384892:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a62c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b14 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788211798.384937:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788211798.384960:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=387s v=(0 0) 00010000:00010000:1.0:1788211798.384965:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211798.384976:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a62c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b14 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.384996:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a62c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b14 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.385010:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b400, rc 0) 00000100:00100000:1.0:1788211798.385210:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2361:x1875075637794560:12345-192.168.204.29@tcp:101:bash.0 Request processed in 375us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211798.385218:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:3.0:1788211798.388262:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211798.388434:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637794688 00000100:00100000:0.0:1788211798.388445:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637794688 00000100:00100000:0.0:1788211798.388497:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:0.0:1788211798.388506:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:11591:x1875075637794688:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1788211798.388523:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211798.388541:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b1b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.388572:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a62c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b14 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.388597:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211798.388600:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211798.388606:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.388655:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a62c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b14 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.388668:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a62c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b14 expref: 7 pid: 6696 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211798.388681:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1875075660854912:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211798.388783:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd879d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788211798.393131:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1875075660854912:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211798.393210:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.393233:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd400, rc 0) 00000100:00100000:0.0:1788211798.393287:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:11591:x1875075637794688:12345-192.168.204.29@tcp:101:bash.0 Request processed in 4781us (5036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211798.393296:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:3.0:1788211798.394268:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211798.394481:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637794816 00000100:00100000:2.0:1788211798.394489:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637794816 00010000:00010000:2.0:1788211798.394525:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a62c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b14 expref: 7 pid: 6696 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211798.394556:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 75 00000100:00100000:2.0:1788211798.394565:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637794816:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211798.394579:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211798.394608:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a62c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b14 expref: 7 pid: 6696 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.394660:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a62c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b14 expref: 7 pid: 6696 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.394692:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a62c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b14 expref: 7 pid: 6696 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.394712:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211798.394717:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211798.394726:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.394738:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.394780:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211798.394807:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac00132b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1875075660855040:192.168.204.29@tcp:105: 00000100:00100000:2.0:1788211798.395117:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6631240 going to sleep for 11 seconds 00000100:00100000:2.0:1788211798.401035:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac00132b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1875075660855040:192.168.204.29@tcp:105: 00010000:00010000:2.0:1788211798.401075:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211798.401141:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637794816:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 6573us (6873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211798.401153:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 75 00000100:00100000:0.0:1788211798.405394:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211798.405587:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637795072 00000100:00100000:1.0:1788211798.405598:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637795072 00000100:00100000:1.0:1788211798.405679:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:1.0:1788211798.405700:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+38:11591:x1875075637795072:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:0.0:1788211798.406990:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:11591:x1875075637795072:12345-192.168.204.29@tcp:35:bash.0 Request processed in 1284us (1598us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788211798.407016:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:0.0:1788211798.627122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211798.627414:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637795200 00000100:00100000:2.0:1788211798.627426:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637795200 00000100:00100000:2.0:1788211798.627497:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 200 00000100:00100000:2.0:1788211798.627510:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+39:11607:x1875075637795200:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211798.627539:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211798.627564:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a62d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.627668:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a62dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.627697:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a62dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.627710:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a62dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211798.627784:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1788211798.627789:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211798.627830:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a62dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.627859:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a62d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b22 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.627880:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a62dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b22 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.627890:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211798.627894:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211798.627917:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7e00, rc 0) 00000100:00100000:2.0:1788211798.627994:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+40:11607:x1875075637795200:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 487us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211798.628002:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 200 00000100:00100000:2.0:1788211798.644596:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211798.652038:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637795456 00000100:00100000:3.0:1788211798.652121:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637795456 00000100:00100000:0.0:1788211798.654271:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 201 00000100:00100000:0.0:1788211798.654297:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00132b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+40:11607:x1875075637795456:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788211798.654328:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211798.654363:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a62e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b29 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.654483:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a62eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.654498:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a62eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.654511:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a62eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211798.654526:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788211798.654698:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a62e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b29 expref: 43 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.654722:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a62eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b29 expref: 42 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.654731:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:0.0:1788211798.654735:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788211798.654739:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cda00, rc 0) 00000100:00100000:0.0:1788211798.654843:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00132b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:11607:x1875075637795456:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 557us (10258us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788211798.654867:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 201 00000100:00100000:3.0:1788211798.661292:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211798.661355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211798.661589:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637795712 00000100:00100000:2.0:1788211798.661601:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637795712 00000100:00100000:2.0:1788211798.661693:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 202 00000100:00100000:2.0:1788211798.661707:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+42:11607:x1875075637795712:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211798.661732:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211798.661753:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a62f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b30 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.661884:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a6300 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.661902:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a6300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.661914:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a6300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211798.661928:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788211798.662080:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a62f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b30 expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.662098:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a6300 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b30 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.662108:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211798.662124:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788211798.662128:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6a00, rc 0) 00000100:00100000:2.0:1788211798.662231:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+44:11607:x1875075637795712:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 527us (883us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788211798.662238:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 202 00000100:00100000:1.0:1788211798.664382:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637795840 00000100:00100000:1.0:1788211798.664402:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637795840 00000100:00100000:1.0:1788211798.664488:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:1.0:1788211798.664499:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+44:2360:x1875075637795840:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211798.664515:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211798.664540:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a62eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b29 expref: 44 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.664582:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:1.0:1788211798.664587:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211798.664660:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+43:2360:x1875075637795840:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 162us (3380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211798.664668:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:3.0:1788211798.672592:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211798.673672:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637795968 00000100:00100000:2.0:1788211798.673698:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637795968 00000100:00100000:2.0:1788211798.673788:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00100000:2.0:1788211798.674269:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+6:2359:x1875075637795968:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:2.0:1788211798.674320:0:8290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.674342:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.674351:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211798.674356:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788211798.674361:0:8290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.674403:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.674417:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 6 pid: 6695 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211798.674432:0:8290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8290:1875075660855168:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211798.674565:0:8290:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff66313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211798.679258:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211798.679401:0:8290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8290:1875075660855168:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211798.679434:0:8290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211798.679657:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637796096 00000100:00100000:3.0:1788211798.679667:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637796096 00002000:00100000:3.0:1788211798.679742:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8abff6461f80 x1875075637796096/t0(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:349/0 lens 504/0 e 0 to 0 dl 1788211809 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211798.679753:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abff6461f80 with x1875075637796096 ext(0->8) 00010000:00010000:3.0:1788211798.679762:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 7 pid: 6695 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.679777:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 7 pid: 6695 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788211798.679785:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8abff6461f80 00000100:00100000:3.0:1788211798.679967:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1788211798.679980:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2358:x1875075637796096:12345-192.168.204.29@tcp:4:lfs.0 00000100:00100000:3.0:1788211798.681691:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2358:x1875075637796096:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 1694us (2433us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788211798.681704:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00002000:00100000:3.0:1788211798.681716:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8abff6461f80 x1875075637796096/t4294967308(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:349/0 lens 504/448 e 0 to 0 dl 1788211809 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211798.681744:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abff6461f80 with x1875075637796096 ext(0->8) 00010000:00010000:3.0:1788211798.681756:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 9 pid: 6695 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.681779:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 9 pid: 6695 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788211798.681787:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8abff6461f80 00000100:00100000:3.0:1788211798.685965:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211798.686163:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637796224 00000100:00100000:2.0:1788211798.686265:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637796224 00010000:00010000:2.0:1788211798.686308:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 9 pid: 6695 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211798.686466:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:2.0:1788211798.686479:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2359:x1875075637796224:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211798.686494:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788211798.686516:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788211798.686520:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788211797 00002000:00010000:2.0:1788211798.686522:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788211798 00002000:00010000:2.0:1788211798.686524:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788211797 00010000:00010000:2.0:1788211798.686531:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 9 pid: 6695 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.686544:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 9 pid: 6695 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.686570:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f5db44f/0x2afbce82f55a62cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b1b expref: 9 pid: 6695 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.686588:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788211798.686594:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788211798.686600:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.686648:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.686690:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211798.686773:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637796224:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 297us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211798.686781:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 76 00010000:00010000:0.0:1788211798.687252:0:8290:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.687263:0:8290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.687293:0:8290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.687301:0:8290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.687309:0:8290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.688509:0:8290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211798.688515:0:8290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.688525:0:8290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.688567:0:8290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.688575:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a630e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211798.688725:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637795968:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 14458us (16138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211798.688738:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00100000:3.0:1788211798.691608:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211798.692325:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637796480 00000100:00100000:0.0:1788211798.692337:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637796480 00000100:00100000:0.0:1788211798.692395:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:0.0:1788211798.692405:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc64f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+43:11607:x1875075637796480:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:0.0:1788211798.692477:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a6300 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b30 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788211798.692770:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788211798.692845:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1788211798.694229:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:0.0:1788211798.694388:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.694408:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a62ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b0d expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.694416:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.694478:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a62ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b0d expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211798.694497:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a62ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b0d expref: 47 pid: 5845 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211798.694514:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1875075660855296:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211798.694703:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788211798.702417:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211798.702501:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637796608 00000100:00100000:3.0:1788211798.702511:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637796608 00010000:00010000:3.0:1788211798.702563:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a62ba lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b0d expref: 48 pid: 5845 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211798.702616:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:3.0:1788211798.702641:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+48:2359:x1875075637796608:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211798.702663:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211798.702672:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a62ba lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b0d expref: 48 pid: 5845 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.702700:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a62ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b0d expref: 48 pid: 5845 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.702729:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:3.0:1788211798.702736:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.702768:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.702778:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.702815:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211798.702912:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+48:2359:x1875075637796608:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 284us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211798.702920:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 77 00010000:00010000:1.0:1788211798.703042:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a62ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b0d expref: 47 pid: 5845 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211798.703064:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1875075660855296:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211798.703283:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.703295:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211798.703301:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788211798.703459:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1788211798.703712:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788211798.703847:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875075660855424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788211798.703904:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211798.703946:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788211798.703977:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660855424 00000100:00100000:2.0:1788211798.703983:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660855424 00000100:00100000:2.0:1788211798.704035:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788211798.704044:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875075660855424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788211798.704134:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875075660855424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211798.704141:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788211798.704471:0:5847:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788211798.704478:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abfef8a2680, transno 4294967307 00000100:00100000:1.0:1788211798.704495:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875075660855424:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1788211798.705244:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788211798.705709:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788211798.705787:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdc7df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875075660855552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788211798.705845:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211798.705877:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe1136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211798.706448:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660855552 00000100:00100000:3.0:1788211798.706458:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660855552 00000100:00100000:3.0:1788211798.707351:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788211798.707367:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875075660855552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788211798.707655:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1875075660855552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 292us (1809us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788211798.707664:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788211798.707758:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdc7df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875075660855552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788211798.707851:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788211798.707907:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.707920:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.707928:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.707933:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8ccc00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211798.707939:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.707965:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.707983:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211798.707986:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788211798.707990:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211798.707996:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a6315 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788211798.708238:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788211798.708340:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788211798.708352:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 388014184843ns, next at 389014182217ns, rc = 0 00000001:00080000:2.0:1788211798.708359:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788211798.708393:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211798.708397:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788211798.708405:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a6300 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b30 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211798.708521:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc64f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+50:11607:x1875075637796480:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 16117us (16924us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788211798.708529:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 56 00000020:00080000:2.0:1788211798.708534:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788211798.713262:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211798.713427:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637796736 00000100:00100000:3.0:1788211798.713436:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637796736 00000100:00100000:3.0:1788211798.713543:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 203 00000100:00100000:3.0:1788211798.713559:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+50:11607:x1875075637796736:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211798.713591:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211798.713622:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a631c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b37 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.713783:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a631c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b37 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.713943:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a631c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b37 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.713967:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211798.713971:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788211798.713974:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062200, rc 0) 00000100:00100000:3.0:1788211798.714152:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:11607:x1875075637796736:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 598us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211798.714160:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 203 00000100:00100000:1.0:1788211798.719330:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211798.719502:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637796992 00000100:00100000:0.0:1788211798.719514:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637796992 00000100:00100000:0.0:1788211798.719581:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:0.0:1788211798.719592:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+51:11607:x1875075637796992:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1788211798.720094:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:11607:x1875075637796992:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 503us (793us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788211798.720104:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:2.0:1788211798.874647:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211798.875463:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637797120 00000100:00100000:3.0:1788211798.875478:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637797120 00000100:00100000:3.0:1788211798.875622:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 204 00000100:00100000:3.0:1788211798.875654:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:11617:x1875075637797120:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1788211798.875762:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6323 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.875783:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.875809:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.875825:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a632a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.875842:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a632a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.875871:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a632a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.875994:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6331 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876004:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876010:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788211798.876068:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876082:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876088:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6323 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876095:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6323 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876101:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211798.876106:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6323 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876113:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6323 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876126:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:3.0:1788211798.876134:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211798.876139:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6323 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876145:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6323 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876159:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a632a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876216:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a632a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876223:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a632a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876228:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211798.876231:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a632a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876237:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a632a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876244:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc5bbe100) 00010000:00010000:3.0:1788211798.876247:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211798.876249:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a632a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876255:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a632a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876270:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876281:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6331 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876286:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876290:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211798.876293:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876298:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6331 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876304:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211798.876306:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211798.876309:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6331 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.876313:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6331 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211798.876406:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:11617:x1875075637797120:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 763us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211798.876414:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 204 00000100:00100000:1.0:1788211798.989910:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211798.990076:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637797376 00000100:00100000:3.0:1788211798.990090:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637797376 00000100:00100000:3.0:1788211798.990190:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 205 00000100:00100000:3.0:1788211798.990205:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+52:11620:x1875075637797376:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211798.990233:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211798.990284:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6338 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.990526:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a633f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.990544:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a633f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.990556:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a633f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.990573:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.990581:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.990588:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.990778:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a634d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.990868:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a634d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.990877:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a634d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211798.990889:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788211798.991020:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a633f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991202:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a633f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991211:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a633f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991217:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211798.991222:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a633f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991229:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a633f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991240:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:3.0:1788211798.991243:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211798.991250:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a633f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991256:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a633f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991271:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991278:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6346 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991284:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991289:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211798.991299:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991699:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6346 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991712:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc5bbe100) 00010000:00010000:3.0:1788211798.991715:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211798.991718:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6346 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991724:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991798:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6338 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b3e expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991817:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a634d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b3e expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.991824:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211798.991835:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211798.991838:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063600, rc 0) 00000100:00100000:3.0:1788211798.991961:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:11620:x1875075637797376:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1758us (2061us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788211798.991970:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 205 00000100:00100000:2.0:1788211798.996748:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211798.996853:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637797504 00000100:00100000:3.0:1788211798.996865:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637797504 00000100:00100000:3.0:1788211798.996937:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 206 00000100:00100000:3.0:1788211798.996949:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:11620:x1875075637797504:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:3.0:1788211798.997056:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a635b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.997076:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a635b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.997090:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a635b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.997121:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a635b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.997129:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a635b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.997136:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a635b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.997142:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211798.997146:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a635b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.997155:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a635b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.997192:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211798.997195:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788211798.997200:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a635b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211798.997206:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a635b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211798.997440:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:11620:x1875075637797504:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 492us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211798.997448:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 206 00000100:00100000:0.0:1788211799.022794:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.028328:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637797760 00000100:00100000:2.0:1788211799.028350:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637797760 00000100:00100000:2.0:1788211799.028473:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 58 00000100:00100000:2.0:1788211799.028498:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+54:11620:x1875075637797760:12345-192.168.204.29@tcp:35:lfs.0 00000100:00080000:3.0:1788211799.028888:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211799.029269:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:11620:x1875075637797760:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 781us (6484us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788211799.029279:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 58 00000100:00100000:1.0:1788211799.171305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211799.171415:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637798016 00000100:00100000:3.0:1788211799.171427:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637798016 00000100:00100000:3.0:1788211799.171502:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 207 00000100:00100000:3.0:1788211799.171517:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+55:11630:x1875075637798016:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:3.0:1788211799.171549:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211799.171553:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788211799.171583:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a62dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b22 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.171602:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:3.0:1788211799.171607:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788211799.171632:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6362 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b45 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.171768:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6369 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.171784:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.171796:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211799.171809:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788211799.172022:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a6362 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b45 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.172384:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b45 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.172394:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211799.172396:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211799.172399:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063800, rc 0) 00000100:00100000:3.0:1788211799.172462:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:11630:x1875075637798016:12345-192.168.204.29@tcp:101:bash.0 Request processed in 949us (1178us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788211799.172471:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 207 00000100:00100000:1.0:1788211799.178560:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211799.178667:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637798272 00000100:00100000:3.0:1788211799.178681:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637798272 00000100:00100000:3.0:1788211799.178751:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 208 00000100:00100000:3.0:1788211799.178765:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:11630:x1875075637798272:12345-192.168.204.29@tcp:36:bash.0 00010000:00010000:3.0:1788211799.178874:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788211799.178918:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6369 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b45 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.178945:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a634d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b3e expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.178956:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211799.178963:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788211799.179314:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6377 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.179350:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.179360:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788211799.179416:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:3.0:1788211799.179442:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b202a17d reply state 00000000e713286d transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211799.179452:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788211799.179575:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:11630:x1875075637798272:12345-192.168.204.29@tcp:36:bash.0 Request processed in 812us (1028us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788211799.179583:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 208 00000020:00080000:3.0:1788211799.179588:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788211799.182505:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.182530:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6377 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.182539:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.182546:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211799.182553:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.182562:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6377 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.182581:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:2.0:1788211799.182584:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211799.182589:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6377 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.182596:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6377 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211799.185638:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211799.187918:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637798400 00000100:00100000:0.0:1788211799.187940:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637798400 00000100:00100000:0.0:1788211799.188080:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 209 00000100:00100000:0.0:1788211799.188093:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+56:11630:x1875075637798400:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1788211799.188126:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211799.188159:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a637e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b4c expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.188507:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.188523:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.188535:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211799.188570:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788211799.188575:0:9952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788211799.188596:0:9952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.188640:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a637e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b4c expref: 58 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.188662:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b4c expref: 57 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.188672:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:0.0:1788211799.188675:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788211799.188679:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc600, rc 0) 00000100:00100000:0.0:1788211799.188769:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:11630:x1875075637798400:12345-192.168.204.29@tcp:101:bash.0 Request processed in 678us (3151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211799.188777:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 209 00000100:00100000:1.0:1788211799.195076:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211799.195403:0:12483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637798656 00000100:00100000:3.0:1788211799.195414:0:12483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637798656 00000100:00100000:3.0:1788211799.195476:0:12483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:3.0:1788211799.195490:0:12483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+57:11630:x1875075637798656:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:3.0:1788211799.195931:0:12483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+58:11630:x1875075637798656:12345-192.168.204.29@tcp:35:bash.0 Request processed in 442us (890us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788211799.195942:0:12483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 59 00010000:00010000:1.0:1788211799.205658:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211799.283212:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211799.283544:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637798784 00000100:00100000:3.0:1788211799.283557:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637798784 00000100:00100000:3.0:1788211799.283686:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 210 00000100:00100000:3.0:1788211799.283698:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+58:11636:x1875075637798784:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211799.283724:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211799.283758:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a638c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b53 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.284128:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6393 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.284145:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.284157:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211799.284469:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1788211799.284475:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211799.284515:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.284552:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a638c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b53 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.284571:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6393 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b53 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.284581:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211799.284584:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211799.284587:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063800, rc 0) 00000100:00100000:2.0:1788211799.284729:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:11636:x1875075637798784:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1032us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.284738:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 210 00000100:00100000:0.0:1788211799.288776:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211799.289426:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637798912 00000100:00100000:3.0:1788211799.289436:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637798912 00000100:00100000:3.0:1788211799.289528:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 211 00000100:00100000:3.0:1788211799.289539:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:11636:x1875075637798912:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211799.289560:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211799.289583:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a639a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b5a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.289703:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a63a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.289723:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a63a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.289737:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a63a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.289759:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a63a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.289778:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a63a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.289799:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a63a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.289967:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.289976:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.289983:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211799.290031:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788211799.290464:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211799.290491:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290504:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290512:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a63a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290519:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a63a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290525:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a63a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290542:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211799.290547:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a63a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290554:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a63a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290568:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:3.0:1788211799.290572:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211799.290577:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a63a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290583:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063400/0x2afbce82f55a63a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290596:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a63a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290602:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a63a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290608:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a63a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290613:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211799.290615:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a63a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290635:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a63a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290652:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc5bbe100) 00010000:00010000:3.0:1788211799.290654:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211799.290658:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a63a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290663:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a63a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290701:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a639a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b5a expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290715:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b5a expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.290721:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211799.290724:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211799.290726:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063000, rc 0) 00000100:00100000:3.0:1788211799.291194:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:11636:x1875075637798912:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1652us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211799.291204:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 211 00000100:00100000:1.0:1788211799.294146:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211799.294318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211799.294402:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637799296 00000100:00100000:0.0:1788211799.294424:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637799296 00000100:00100000:0.0:1788211799.294477:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 212 00000100:00100000:0.0:1788211799.294486:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:11636:x1875075637799296:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788211799.294506:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211799.294526:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a63b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b61 expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.294640:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.294656:0:9952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6385 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b4c expref: 61 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.294663:0:9952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b5a expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.294670:0:9952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.294704:0:9952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b5a expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.294718:0:9952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b5a expref: 61 pid: 5844 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211799.294732:0:9952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9952:1875075660855680:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211799.294876:0:9952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b4c expref: 61 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.294896:0:9952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b4c expref: 61 pid: 9952 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211799.294906:0:9952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9952:1875075660855808:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211799.294939:0:9952:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788211799.295033:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637799040 00000100:00100000:2.0:1788211799.295039:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637799040 00010000:00010000:2.0:1788211799.295075:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b5a expref: 62 pid: 5844 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211799.295109:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:2.0:1788211799.295118:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+62:2359:x1875075637799040:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211799.295130:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211799.295148:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b5a expref: 62 pid: 5844 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.295162:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b5a expref: 62 pid: 5844 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.295305:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:2.0:1788211799.295312:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.295324:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.295331:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211799.295376:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+62:2359:x1875075637799040:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 258us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.295385:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:1.0:1788211799.298362:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1788211799.298376:0:9952:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.29@tcp) returned -22 from blocking AST (req@00000000a2b7bec8 x1875075660855680) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b5a expref: 61 pid: 5844 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.298399:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a63af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b5a expref: 61 pid: 5844 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211799.298416:0:9952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9952:1875075660855680:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211799.298429:0:9952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9952:1875075660855808:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211799.298452:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:0.0:1788211799.298458:0:9952:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.298468:0:9952:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.298477:0:9952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211799.298643:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637799424 00000100:00100000:2.0:1788211799.298651:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637799424 00010000:00010000:2.0:1788211799.298700:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b4c expref: 61 pid: 9952 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211799.298732:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:2.0:1788211799.298743:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:2359:x1875075637799424:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211799.298760:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211799.298767:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b4c expref: 61 pid: 9952 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.298792:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b4c expref: 61 pid: 9952 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.298814:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6385 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b4c expref: 61 pid: 9952 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.298847:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:2.0:1788211799.298851:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.298858:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.298866:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.298896:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211799.298974:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:2359:x1875075637799424:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 232us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.298982:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 79 00010000:00010000:0.0:1788211799.298998:0:9952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.299017:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211799.299042:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788211799.299297:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a63b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b61 expref: 61 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.299315:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b61 expref: 60 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211799.299323:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:0.0:1788211799.299326:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788211799.299329:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cdc00, rc 0) 00000100:00100000:0.0:1788211799.299368:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:11636:x1875075637799296:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 4882us (5050us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788211799.299375:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 212 00000100:00100000:1.0:1788211799.301254:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.301315:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637799680 00000100:00100000:2.0:1788211799.301326:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637799680 00000100:00100000:2.0:1788211799.301395:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:2.0:1788211799.301407:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:11636:x1875075637799680:12345-192.168.204.29@tcp:103:lfs.0 00010000:00010000:2.0:1788211799.301433:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211799.301462:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062200/0x2afbce82f55a631c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b37 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.301485:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:2.0:1788211799.301491:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211799.301550:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:11636:x1875075637799680:12345-192.168.204.29@tcp:103:lfs.0 Request processed in 146us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.301558:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:1.0:1788211799.303511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.303793:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637799808 00000100:00100000:2.0:1788211799.303808:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637799808 00000100:00100000:2.0:1788211799.303878:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 213 00000100:00100000:2.0:1788211799.303890:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:11636:x1875075637799808:12345-192.168.204.29@tcp:58:lfs.0 00010000:00010000:2.0:1788211799.304000:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a63cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.304019:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a63cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.304031:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a63cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788211799.304907:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788211799.305242:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:11636:x1875075637799808:12345-192.168.204.29@tcp:58:lfs.0 Request processed in 1351us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.305253:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 213 00000100:00100000:1.0:1788211799.307365:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211799.307465:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637799936 00000100:00100000:3.0:1788211799.307478:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637799936 00000100:00100000:3.0:1788211799.307591:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 214 00000100:00100000:3.0:1788211799.307604:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+59:11636:x1875075637799936:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211799.307638:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211799.307660:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a63d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b68 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.307749:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a63cb lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.307761:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a63d2 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b68 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.307785:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a63cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.307800:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a63d2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b68 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.307818:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211799.307821:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788211799.307825:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a63d2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b68 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.307848:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062800, rc 0) 00000100:00100000:3.0:1788211799.307980:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:11636:x1875075637799936:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 378us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211799.307987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 214 00000040:00080000:0.0:1788211799.717431:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788211799.717442:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788211799.717486:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788211799.717495:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788211799.720628:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1875075660855936:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788211799.720765:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788211799.726262:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.726404:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637800064 00000100:00100000:2.0:1788211799.726417:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637800064 00000100:00100000:2.0:1788211799.726500:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 215 00000100:00100000:2.0:1788211799.726515:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:11638:x1875075637800064:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788211799.726554:0:9952:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788211799.726970:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1875075660855936:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788211799.727204:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:11638:x1875075637800064:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 693us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.727213:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 215 00000100:00100000:3.0:1788211799.731385:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.731466:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637800192 00000100:00100000:2.0:1788211799.731477:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637800192 00000100:00100000:2.0:1788211799.731530:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 216 00000100:00100000:2.0:1788211799.731539:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:11638:x1875075637800192:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788211799.731819:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a63d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.731850:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a63d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.731864:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a63d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.731881:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a63e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.731888:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a63e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.731894:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a63e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.731920:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a63e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.731928:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a63e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.731934:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a63e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211799.731980:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788211799.731985:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211799.731999:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a63e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732010:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a63d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732023:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a63d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732040:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a63d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732046:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211799.732050:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a63d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732057:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a63d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732069:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfc9a0db00) 00010000:00010000:2.0:1788211799.732072:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211799.732076:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a63d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732082:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a63d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732095:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a63e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732101:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a63e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732106:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a63e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732111:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211799.732118:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a63e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732124:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a63e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732132:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211799.732134:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211799.732137:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a63e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732142:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a63e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732155:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a63e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732161:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a63e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732249:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a63e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732254:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6a00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211799.732256:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a63e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732262:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a63e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732269:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:2.0:1788211799.732271:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211799.732279:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a63e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.732285:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a63e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211799.733260:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:11638:x1875075637800192:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 Request processed in 1714us (1879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.733272:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 216 00000100:00100000:3.0:1788211799.736423:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.736519:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637800448 00000100:00100000:2.0:1788211799.736531:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637800448 00000100:00100000:2.0:1788211799.736782:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 217 00000100:00100000:2.0:1788211799.736795:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+60:11638:x1875075637800448:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211799.736818:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211799.736851:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a63ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b6f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.736971:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a63f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.736987:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a63f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.736998:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a63f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211799.737011:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788211799.737141:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a63f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.737149:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a63f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.739921:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a63f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.739929:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211799.739934:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a63f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.739944:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a63f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.739971:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:2.0:1788211799.739975:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788211799.739980:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a63f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.739987:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a63f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.740069:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a63ee lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b6f expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.740080:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfc9a0db00) 00010000:00010000:2.0:1788211799.740083:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788211799.740087:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a63ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b6f expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.740096:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6600, rc 0) 00000100:00100000:2.0:1788211799.740198:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:11638:x1875075637800448:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 3405us (3785us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1788211799.740224:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 217 00000100:00100000:1.0:1788211799.744217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.744350:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637800576 00000100:00100000:2.0:1788211799.744363:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637800576 00000100:00100000:2.0:1788211799.744443:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 218 00000100:00100000:2.0:1788211799.744454:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:11638:x1875075637800576:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788211799.744495:0:6717:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788211799.744847:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:11638:x1875075637800576:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 393us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.744856:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 218 00000100:00100000:0.0:1788211799.748375:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.748509:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637800832 00000100:00100000:2.0:1788211799.748520:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637800832 00000100:00100000:2.0:1788211799.748583:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 219 00000100:00100000:2.0:1788211799.748594:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:11638:x1875075637800832:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211799.748749:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211799.748754:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788211799.748785:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6393 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b53 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.748806:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211799.748811:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211799.748826:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6403 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b76 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788211799.749573:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788211799.749869:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a640a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.749897:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a640a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.749909:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a640a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.750115:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6403 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b76 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.750135:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a640a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b76 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.750144:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211799.750147:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211799.750152:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7000, rc 0) 00000100:00100000:2.0:1788211799.750547:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+62:11638:x1875075637800832:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1953us (2180us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788211799.750556:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 219 00000100:00100000:3.0:1788211799.753742:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.753826:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637801088 00000100:00100000:2.0:1788211799.753838:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637801088 00000100:00100000:2.0:1788211799.753943:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 220 00000100:00100000:2.0:1788211799.753957:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+62:11638:x1875075637801088:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788211799.754105:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211799.754139:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7000/0x2afbce82f55a640a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b76 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754162:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfc9a0d300) 00010000:00010000:2.0:1788211799.754248:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211799.754279:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6418 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754299:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6418 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754312:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6418 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754326:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a641f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x61fafaf9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754344:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a641f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x61fafaf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754350:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a641f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x61fafaf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754441:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6418 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754450:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6418 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754456:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6418 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754463:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211799.754468:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6418 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754476:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6418 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754491:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211799.754494:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211799.754498:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6418 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754505:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6418 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754515:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a641f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x61fafaf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754520:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a641f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x61fafaf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754525:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a641f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x61fafaf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754531:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211799.754533:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a641f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x61fafaf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754540:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a641f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x61fafaf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754547:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x61fafaf9 (ffff8abfc9a0d700) 00010000:00010000:2.0:1788211799.754549:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211799.754552:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a641f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x61fafaf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.754557:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a641f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x61fafaf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211799.754669:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:11638:x1875075637801088:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 714us (936us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788211799.754676:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 220 00000100:00100000:1.0:1788211799.758134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.758509:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637801216 00000100:00100000:2.0:1788211799.758520:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637801216 00000100:00100000:2.0:1788211799.758832:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 221 00000100:00100000:2.0:1788211799.758843:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+61:11638:x1875075637801216:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211799.758864:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211799.758889:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6426 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b7d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.758931:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a642d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.758946:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a642d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.758957:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a642d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.759467:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6426 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b7d expref: 63 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.759489:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a642d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b7d expref: 62 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.759499:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfc9a0d600) 00010000:00010000:2.0:1788211799.759510:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788211799.759514:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6a00, rc 0) 00000100:00100000:2.0:1788211799.759651:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+62:11638:x1875075637801216:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 809us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.759659:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 221 00000100:00100000:1.0:1788211799.785355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.785442:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637801472 00000100:00100000:2.0:1788211799.785452:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637801472 00000100:00100000:2.0:1788211799.785511:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 222 00000100:00100000:2.0:1788211799.785521:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+62:11638:x1875075637801472:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788211799.785641:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6434 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.785660:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.785673:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788211799.785944:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1788211799.785955:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 389091787236ns, next at 390091784653ns, rc = 0 00000004:00010000:2.0:1788211799.786041:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000238f1f4 reply state 0000000046966806 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211799.786052:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788211799.788926:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+64:11638:x1875075637801472:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 3392us (3570us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788211799.790665:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 222 00010000:00010000:2.0:1788211799.793330:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.793370:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6434 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.793377:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6434 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.793383:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211799.793388:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6434 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.793396:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6434 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.793414:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfc9a0d600) 00010000:00010000:2.0:1788211799.793417:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788211799.793422:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6434 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.793429:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6434 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211799.798302:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.798576:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637801600 00000100:00100000:2.0:1788211799.798588:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637801600 00000100:00100000:2.0:1788211799.798655:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 223 00000100:00100000:2.0:1788211799.798664:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+63:11638:x1875075637801600:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211799.798690:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211799.798720:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a643b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b84 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.798814:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a643b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b84 expref: 64 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.798828:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a643b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b84 expref: 64 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.798847:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfc9a0d600) 00010000:00010000:2.0:1788211799.798850:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788211799.798854:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6200, rc 0) 00000100:00100000:2.0:1788211799.798917:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+64:11638:x1875075637801600:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 253us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.798924:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 223 00000100:00100000:3.0:1788211799.812278:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211799.813034:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637801728 00000100:00100000:0.0:1788211799.813047:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637801728 00000100:00100000:0.0:1788211799.813193:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00080000:3.0:1788211799.813208:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788211799.813210:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2358:x1875075637801728:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788211799.813678:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:2358:x1875075637801728:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 474us (1519us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788211799.813687:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:1.0:1788211799.829584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211799.830156:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637801984 00000100:00100000:0.0:1788211799.830659:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637801984 00000100:00100000:0.0:1788211799.830747:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:0.0:1788211799.830761:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+64:11638:x1875075637801984:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788211799.831578:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+65:11638:x1875075637801984:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 816us (2006us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788211799.831588:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:1.0:1788211799.843265:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.843411:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637802240 00000100:00100000:2.0:1788211799.843422:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637802240 00000100:00100000:2.0:1788211799.843484:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 224 00000100:00100000:2.0:1788211799.843494:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+65:11638:x1875075637802240:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788211799.843625:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+65:11638:x1875075637802240:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 131us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.843632:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 224 00000100:00100000:3.0:1788211799.848581:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.858381:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637802368 00000100:00100000:2.0:1788211799.858404:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637802368 00000100:00100000:2.0:1788211799.858512:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 225 00000100:00100000:2.0:1788211799.858525:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+65:11638:x1875075637802368:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211799.858550:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211799.858601:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6442 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.858712:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6449 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.858727:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.858742:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211799.858808:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211799.861531:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.861620:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a6442 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b8b expref: 67 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.861645:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6449 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b8b expref: 66 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.861656:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfc9a0d600) 00010000:00010000:2.0:1788211799.861659:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788211799.861663:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6600, rc 0) 00000100:00100000:2.0:1788211799.861922:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+66:11638:x1875075637802368:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 3320us (13279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.861932:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 225 00000100:00100000:1.0:1788211799.885121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.885331:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637802496 00000100:00100000:2.0:1788211799.885346:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637802496 00000100:00100000:2.0:1788211799.885449:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:2.0:1788211799.885461:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+10:2358:x1875075637802496:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211799.885488:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211799.885518:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a6450 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b92 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788211799.885556:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95f257, blocks: 0x1 00010000:00010000:2.0:1788211799.885589:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=389s v=(0 0) 00010000:00010000:2.0:1788211799.885594:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211799.885615:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a6450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b92 expref: 11 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.885639:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a6450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b92 expref: 11 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.885657:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7e00, rc 0) 00000100:00100000:2.0:1788211799.885741:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+11:2358:x1875075637802496:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 282us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.885748:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:1.0:1788211799.890504:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211799.892066:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637802752 00000100:00100000:3.0:1788211799.892087:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637802752 00000100:00100000:3.0:1788211799.892221:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 226 00000100:00100000:3.0:1788211799.892238:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+66:11638:x1875075637802752:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788211799.892417:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+66:11638:x1875075637802752:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 182us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211799.892425:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 226 00000100:00100000:3.0:1788211799.904699:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211799.905014:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637802880 00000100:00100000:1.0:1788211799.905034:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637802880 00000100:00100000:1.0:1788211799.905112:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:1.0:1788211799.905123:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+11:11638:x1875075637802880:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788211799.905145:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211799.905209:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5b99 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211799.905253:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a6450 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b92 expref: 12 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211799.905263:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211799.905267:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211799.905272:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b99 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211799.905315:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a6450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b92 expref: 12 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211799.905331:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a6450 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b92 expref: 12 pid: 6693 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211799.905347:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875075660856064:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211799.905466:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113780 going to sleep for 11 seconds 00000100:00100000:1.0:1788211799.911306:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211799.911775:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875075660856064:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211799.911854:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b99 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211799.911885:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b200, rc 0) 00000100:00100000:3.0:1788211799.911973:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+12:11638:x1875075637802880:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 6850us (7292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211799.911983:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:2.0:1788211799.918942:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637803008 00000100:00100000:2.0:1788211799.918958:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637803008 00010000:00010000:2.0:1788211799.919017:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a6450 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b92 expref: 12 pid: 6693 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211799.919209:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:2.0:1788211799.919221:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+12:2358:x1875075637803008:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211799.919259:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211799.919289:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a6450 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b92 expref: 12 pid: 6693 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.919304:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a6450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b92 expref: 12 pid: 6693 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.919330:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a6450 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b92 expref: 12 pid: 6693 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.919348:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211799.919353:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211799.919361:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b99 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.919370:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b99 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211799.919415:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b99 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211799.919430:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1875075660856192:192.168.204.29@tcp:105: 00000100:00100000:2.0:1788211799.919540:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6631480 going to sleep for 11 seconds 00000100:00100000:1.0:1788211799.927506:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211799.927649:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1875075660856192:192.168.204.29@tcp:105: 00010000:00010000:2.0:1788211799.927684:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211799.927762:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+11:2358:x1875075637803008:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 8542us (16466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211799.927786:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:3.0:1788211799.932350:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637803136 00000100:00100000:3.0:1788211799.932372:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637803136 00002000:00100000:3.0:1788211799.932448:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8ac001202300 x1875075637803136/t0(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:350/0 lens 504/0 e 0 to 0 dl 1788211810 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211799.932461:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac001202300 with x1875075637803136 ext(0->12) 00002000:00010000:3.0:1788211799.932467:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ac001202300 00000100:00100000:3.0:1788211799.932512:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:3.0:1788211799.932523:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+11:2359:x1875075637803136:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788211799.933251:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:2359:x1875075637803136:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 Request processed in 726us (5754us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788211799.933271:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00002000:00100000:3.0:1788211799.933282:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8ac001202300 x1875075637803136/t4294967320(0) o4->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:350/0 lens 504/448 e 0 to 0 dl 1788211810 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211799.933290:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac001202300 with x1875075637803136 ext(0->12) 00002000:00010000:3.0:1788211799.933295:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ac001202300 00000100:00100000:1.0:1788211799.937074:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211799.937213:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637803264 00000100:00100000:0.0:1788211799.937223:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637803264 00000100:00100000:0.0:1788211799.937289:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 227 00000100:00100000:0.0:1788211799.937302:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+66:11638:x1875075637803264:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788211800.044553:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+66:11638:x1875075637803264:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 Request processed in 107236us (107471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211800.044571:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 227 00000001:00080000:3.0:1788211800.044667:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:3.0:1788211800.044709:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8abfd879d900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788211800.044714:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abffe3d8f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8abfe488b240 00000020:00080000:3.0:1788211800.044717:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abffe3d8a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ac0012cc000 00000020:00080000:3.0:1788211800.044745:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8abffe2e4d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788211800.044749:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abff6047e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8abfd8505b40 00000020:00080000:3.0:1788211800.044752:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abff6047900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8abfefaa0400 00000004:00080000:3.0:1788211800.044781:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:3.0:1788211800.044800:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788211800.044848:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:3.0:1788211800.045016:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660856576:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788211800.045016:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660856448:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788211800.045093:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788211800.045340:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1788211800.045515:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660856320:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788211800.045589:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788211800.050736:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211800.050816:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660856448 00000100:00100000:0.0:1788211800.050830:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660856448 00000100:00100000:0.0:1788211800.050914:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660856576 00000100:00100000:0.0:1788211800.050917:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660856576 00000100:00100000:1.0:1788211800.050935:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788211800.050957:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660856448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788211800.051003:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1788211800.051048:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.051080:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6220 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5af8 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211800.051082:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1788211800.051090:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00000100:00100000:0.0:1788211800.051092:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff7081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1875075660856576:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788211800.051095:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788211800.051101:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.051137:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6220 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5af8 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.051151:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6220 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5af8 expref: 12 pid: 6696 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211800.051316:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1875075660856704:192.168.204.29@tcp:104: 00002000:00010000:0.0:1788211800.051317:0:8290:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788211800.051320:0:8290:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788211799 00002000:00010000:0.0:1788211800.051323:0:8290:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788211800.051325:0:8290:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788211799 -> 1788211799 00002000:00010000:0.0:1788211800.051337:0:8290:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788211800.051523:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788211800.051555:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788211800.051572:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788211800.051582:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788211800.051582:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788211800.051589:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660856320 00000100:00100000:2.0:1788211800.051593:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660856320 00000100:00080000:2.0:1788211800.051637:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788211800.052725:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff7081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3311:x1875075660856576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1626us (1991us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788211800.052739:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788211800.052775:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788211800.052785:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660856320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788211800.052820:0:8290:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1788211800.052856:0:8290:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a95f255, atime: 0x6a95f256, ctime: 0x6a95f255, blocks: 0x1 00010000:00010000:0.0:1788211800.052864:0:8290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add8474e/0x2afbce82f55a6465 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.052879:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=389s v=(0 0) 00010000:00010000:0.0:1788211800.052884:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211800.052891:0:8290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add8474e/0x2afbce82f55a6465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.052909:0:8290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000add8474e/0x2afbce82f55a6465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.052919:0:8290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add8474e/0x2afbce82f55a6465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.052928:0:8290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000add8474e/0x2afbce82f55a6465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211800.053138:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788211800.053308:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000004:00080000:1.0:1788211800.053327:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abfef636300/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788211800.053335:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660856576:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788211800.053448:0:8290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788211800.054081:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660856320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1295us (2555us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788211800.054100:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788211800.054125:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637803392 00000100:00100000:0.0:1788211800.054133:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637803392 00000100:00100000:0.0:1788211800.054187:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:0.0:1788211800.054196:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:2359:x1875075637803392:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1788211800.054198:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abffe3b0380/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788211800.054204:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660856320:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788211800.054480:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211800.054489:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000add8474e/0x2afbce82f55a6465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.054503:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211800.054508:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000add8474e/0x2afbce82f55a6465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.054519:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000add8474e/0x2afbce82f55a6465 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.054549:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000add8474e/0x2afbce82f55a6465 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.054557:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000add8474e/0x2afbce82f55a6465 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.054597:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211800.054599:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211800.054612:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211800.055692:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1875075660856704:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788211800.055737:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211800.065371:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211800.069287:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637803520 00000100:00100000:3.0:1788211800.069306:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637803520 00010000:00010000:3.0:1788211800.069373:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6220 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5af8 expref: 14 pid: 6696 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211800.069424:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:3.0:1788211800.069436:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+14:2359:x1875075637803520:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211800.069453:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211800.069461:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6220 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5af8 expref: 14 pid: 6696 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.069478:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6220 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5af8 expref: 14 pid: 6696 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.069508:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6220 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5af8 expref: 14 pid: 6696 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.069526:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788211800.069532:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788211800.069538:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.069568:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.069613:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211800.069692:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+13:2359:x1875075637803520:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 258us (4333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211800.069701:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 81 00010000:00010000:3.0:1788211800.069886:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.069899:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.069910:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.069919:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.069942:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788211800.070547:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3310:x1875075660856448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19600us (25452us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788211800.070558:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1788211800.070738:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211800.070746:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.070765:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ba00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211800.070771:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.070781:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.070798:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.070807:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a645e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.070828:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211800.070830:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211800.070832:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788211800.070879:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abfef635180/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788211800.070887:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660856448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788211800.107497:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+12:2359:x1875075637803392:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 Request processed in 53277us (54165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211800.107518:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 69 00000001:00080000:3.0:1788211800.107577:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1788211800.107591:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1788211800.107616:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1788211800.115506:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211800.115680:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637803776 00000100:00100000:2.0:1788211800.115694:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637803776 00000100:00100000:2.0:1788211800.115784:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 228 00000100:00100000:2.0:1788211800.115798:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:11638:x1875075637803776:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788211800.115894:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211800.115935:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6449 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b8b expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.115963:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfc9a0d600) 00010000:00010000:2.0:1788211800.115969:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211800.116474:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a646c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.116494:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a646c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.116507:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a646c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788211800.116895:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d77eef5 reply state 000000006019cf36 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a646c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211800.116907:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788211800.117721:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:11638:x1875075637803776:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 1919us (2229us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788211800.117775:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 228 00000100:00100000:3.0:1788211800.125663:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:2.0:1788211800.125801:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a646c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.125818:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a646c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.125827:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a646c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.125833:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211800.125840:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a646c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.125849:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a646c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.125873:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfc9a0d600) 00010000:00010000:2.0:1788211800.125877:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211800.125883:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a646c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.125891:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7e00/0x2afbce82f55a646c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211800.127563:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637803904 00000100:00100000:1.0:1788211800.127586:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637803904 00000100:00100000:1.0:1788211800.127740:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:1.0:1788211800.127759:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2358:x1875075637803904:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788211800.128087:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788211800.128092:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788211799 -> 1788211798 00002000:00010000:1.0:1788211800.128094:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788211798 00002000:00010000:1.0:1788211800.128097:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788211799 -> 1788211798 00002000:00010000:1.0:1788211800.128099:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788211800.128229:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2358:x1875075637803904:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 473us (2580us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788211800.128238:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:0.0:1788211800.132052:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211800.132146:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637804160 00000100:00100000:2.0:1788211800.132194:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637804160 00000100:00100000:2.0:1788211800.132254:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 229 00000100:00100000:2.0:1788211800.132264:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:11638:x1875075637804160:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788211800.132346:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.132372:0:6717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a642d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b7d expref: 20 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.132382:0:6717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.132422:0:6717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a642d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b7d expref: 20 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.132437:0:6717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a642d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b7d expref: 20 pid: 6717 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211800.132455:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef634a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660856832:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211800.132570:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8f759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211800.138941:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef634a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660856832:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211800.138983:0:6717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211800.141760:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211800.142217:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637804288 00000100:00100000:2.0:1788211800.142232:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637804288 00010000:00010000:2.0:1788211800.142290:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a642d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b7d expref: 21 pid: 6717 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211800.142336:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 82 00000100:00100000:2.0:1788211800.142348:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:2358:x1875075637804288:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211800.142366:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211800.142394:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a642d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b7d expref: 21 pid: 6717 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.142409:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a642d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b7d expref: 21 pid: 6717 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.142438:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6a00/0x2afbce82f55a642d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b7d expref: 21 pid: 6717 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.142457:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfc9a0d600) 00010000:00010000:2.0:1788211800.142462:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.142474:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.142481:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.142525:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211800.142620:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:2358:x1875075637804288:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 273us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211800.142628:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 82 00010000:00010000:1.0:1788211800.142722:0:6717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.142732:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.142782:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.142791:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.142797:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.142812:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211800.142816:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.142824:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.142848:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfc9a0d600) 00010000:00010000:1.0:1788211800.142851:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788211800.142855:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.142862:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6600/0x2afbce82f55a6473 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211800.142908:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:11638:x1875075637804160:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 Request processed in 10646us (10867us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788211800.142919:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 229 00000100:00100000:0.0:1788211800.148758:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211800.148927:0:12590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637804416 00000100:00100000:2.0:1788211800.148937:0:12590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637804416 00000100:00100000:2.0:1788211800.149283:0:12590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00100000:2.0:1788211800.149296:0:12590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2358:x1875075637804416:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788211800.149362:0:12590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.149416:0:12590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b99 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.149426:0:12590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211800.149431:0:12590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788211800.149436:0:12590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.149486:0:12590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b99 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.149504:0:12590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b99 expref: 8 pid: 6696 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211800.149524:0:12590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef634a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12590:1875075660856960:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211800.149697:0:12590:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8f759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211800.156651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211800.156793:0:12590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef634a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12590:1875075660856960:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211800.157527:0:12590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211800.157756:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637804544 00000100:00100000:3.0:1788211800.157832:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637804544 00010000:00010000:3.0:1788211800.157892:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b99 expref: 9 pid: 6696 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211800.157974:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:3.0:1788211800.157986:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+9:2359:x1875075637804544:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211800.158015:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211800.158055:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b99 expref: 9 pid: 6696 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.158072:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b99 expref: 9 pid: 6696 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.158102:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3c77a38/0x2afbce82f55a6457 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b99 expref: 9 pid: 6696 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.158120:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788211800.158124:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788211800.158131:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.158142:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.158369:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211800.158459:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2359:x1875075637804544:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 474us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211800.158467:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 83 00010000:00010000:1.0:1788211800.159927:0:12590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.159952:0:12590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.160123:0:12590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.160134:0:12590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.160305:0:12590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.160313:0:12590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788211800.160319:0:12590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.160330:0:12590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.160357:0:12590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.160366:0:12590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006db30704/0x2afbce82f55a647a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211800.160508:0:12590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2358:x1875075637804416:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 Request processed in 11208us (11759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211800.160520:0:12590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00100000:2.0:1788211800.168579:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211800.168791:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637804800 00000100:00100000:0.0:1788211800.168806:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637804800 00000100:00100000:0.0:1788211800.168889:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 230 00000100:00100000:0.0:1788211800.168901:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:11638:x1875075637804800:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788211800.169027:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6481 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.169054:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.169067:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.169623:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.169655:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a643b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b84 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.169664:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.169713:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a643b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b84 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.169730:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a643b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b84 expref: 20 pid: 5844 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211800.169746:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660857088:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211800.169915:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6631480 going to sleep for 11 seconds 00000100:00100000:1.0:1788211800.175615:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660857088:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211800.175663:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211800.176691:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211800.177379:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637804928 00000100:00100000:3.0:1788211800.177393:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637804928 00010000:00010000:3.0:1788211800.177448:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a643b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b84 expref: 21 pid: 5844 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211800.177525:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:3.0:1788211800.177538:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:2358:x1875075637804928:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211800.177561:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211800.177570:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a643b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b84 expref: 21 pid: 5844 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.177586:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a643b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b84 expref: 21 pid: 5844 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.177628:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6200/0x2afbce82f55a643b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b84 expref: 21 pid: 5844 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.177655:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfc9a0d600) 00010000:00010000:3.0:1788211800.177662:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.177675:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.177685:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.177744:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211800.178010:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:2358:x1875075637804928:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 473us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211800.178027:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 84 00010000:00010000:1.0:1788211800.178332:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.178351:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788211800.178592:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788211800.178799:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1788211800.178850:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788211800.178961:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875075660857216:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788211800.179092:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211800.179325:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660857216 00000100:00100000:1.0:1788211800.179336:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660857216 00000100:00100000:1.0:1788211800.179394:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788211800.179403:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875075660857216:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788211800.179481:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875075660857216:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211800.179489:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788211800.179516:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4ad9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788211800.179540:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1788211800.179547:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1788211800.179571:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abfef636300, transno 4294967321 00000100:00100000:1.0:1788211800.179591:0:5843:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8abfef635180 x1875075660856448/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788211816 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211800.179618:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875075660857216:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788211800.180928:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1788211800.181261:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875075660857344:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788211800.181332:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211800.181400:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660857344 00000100:00100000:1.0:1788211800.181418:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660857344 00000100:00100000:1.0:1788211800.181470:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788211800.181478:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875075660857344:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788211800.181728:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5843:x1875075660857344:12345-0@lo:1000:mdt00_000.0 Request processed in 250us (396us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788211800.181736:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788211800.184589:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffbc3b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788211800.184672:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875075660857344:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788211800.184736:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.184751:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.184759:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185495:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211800.185501:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185511:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185613:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfc9a0d600) 00010000:00010000:1.0:1788211800.185617:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788211800.185623:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185630:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6488 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185707:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a63cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185714:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a63cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185720:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a63cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185726:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211800.185729:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a63cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185735:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a63cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185743:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:1.0:1788211800.185746:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788211800.185757:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a63d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b68 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185855:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a63d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b68 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185866:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a63d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b68 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211800.185923:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a63d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b68 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211800.185955:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660857472:192.168.204.29@tcp:105: 00000100:00100000:1.0:1788211800.186401:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788211800.198283:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211800.198461:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875075660857472:192.168.204.29@tcp:105: 00010000:00010000:0.0:1788211800.198499:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a63cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198512:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6e00/0x2afbce82f55a63cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198565:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a648f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198583:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a648f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198596:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a648f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198639:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a648f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198645:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a648f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198651:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a648f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198657:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211800.198663:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a648f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198669:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a648f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198682:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:0.0:1788211800.198686:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211800.198690:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a648f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198697:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a648f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198707:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198713:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6481 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198720:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198731:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211800.198734:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198740:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6481 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198749:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:0.0:1788211800.198751:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788211800.198754:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6481 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.198759:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6481 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211800.199079:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:11638:x1875075637804800:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 30174us (30516us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1788211800.199092:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 230 00000020:00080000:0.0:1788211800.199099:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788211800.199824:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788211800.199832:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788211800.199882:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788211800.199890:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788211800.200488:0:12483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637805056 00000100:00100000:3.0:1788211800.200502:0:12483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637805056 00000100:00100000:3.0:1788211800.200589:0:12483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:3.0:1788211800.200614:0:12483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:11636:x1875075637805056:12345-192.168.204.29@tcp:49:lfs.0 00000100:00100000:3.0:1788211800.200796:0:12483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:11636:x1875075637805056:12345-192.168.204.29@tcp:49:lfs.0 Request processed in 195us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211800.200804:0:12483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:1.0:1788211800.208676:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211800.208811:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637805312 00000100:00100000:2.0:1788211800.208827:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637805312 00000100:00100000:2.0:1788211800.208904:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00100000:2.0:1788211800.208916:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc64fbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+23:11638:x1875075637805312:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788211800.213518:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211800.213663:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637805568 00000100:00100000:3.0:1788211800.213677:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637805568 00000100:00100000:3.0:1788211800.213756:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 231 00000100:00100000:3.0:1788211800.213769:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+24:11636:x1875075637805568:12345-192.168.204.29@tcp:58:lfs.0 00000040:00080000:3.0:1788211800.214623:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788211800.215529:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+24:11636:x1875075637805568:12345-192.168.204.29@tcp:58:lfs.0 Request processed in 1244us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211800.215548:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 231 00000004:00080000:0.0:1788211800.222483:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788211800.222616:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1788211800.222689:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6496 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.222709:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6496 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.222722:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6496 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.222745:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6496 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.222752:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6496 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.222759:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6496 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211800.222781:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788211800.222918:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc64fbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+25:11638:x1875075637805312:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 13997us (14250us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788211800.222930:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 62 00000020:00080000:0.0:1788211800.222938:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788211800.223810:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211800.223826:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6496 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.223839:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211800.223844:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6496 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.223878:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6496 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.223902:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:3.0:1788211800.223905:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788211800.223910:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6496 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.223916:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6496 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.223942:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211800.223944:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211800.223946:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211800.235137:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211800.274450:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211800.274573:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637805696 00000100:00100000:2.0:1788211800.274582:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637805696 00000100:00100000:2.0:1788211800.274947:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 232 00000100:00100000:2.0:1788211800.274961:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+25:11640:x1875075637805696:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1788211800.274989:0:6717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211800.275010:0:6717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a649d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ba0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.275497:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a64a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.275514:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a64a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.275526:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a64a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.275542:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a64ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.275549:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a64ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.275556:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a64ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.276446:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a64b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.276466:0:6717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b61 expref: 26 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.276476:0:6717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a64b2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.276537:0:6717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b61 expref: 26 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.276556:0:6717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b61 expref: 26 pid: 9952 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211800.276575:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef637b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660857600:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211800.277109:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8f759c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211800.283158:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211800.283693:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637805952 00000100:00100000:0.0:1788211800.283704:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637805952 00000100:00100000:0.0:1788211800.283761:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:0.0:1788211800.283782:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+27:5600:x1875075637805952:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788211800.284071:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:5600:x1875075637805952:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 290us (936us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788211800.284079:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:0.0:1788211800.287627:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211800.287796:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637806080 00000100:00100000:3.0:1788211800.287812:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637806080 00010000:00010000:3.0:1788211800.287981:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b61 expref: 28 pid: 9952 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211800.288054:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:3.0:1788211800.288067:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:2359:x1875075637806080:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211800.288092:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211800.288101:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b61 expref: 28 pid: 9952 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.288117:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b61 expref: 28 pid: 9952 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.288381:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211800.288389:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a64b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.288401:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a64b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.288410:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a64b2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211800.288435:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211800.288527:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:2359:x1875075637806080:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 461us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211800.288536:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 85 00010000:00010000:2.0:1788211800.290758:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a63bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b61 expref: 27 pid: 9952 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211800.290953:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef637b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6717:1875075660857600:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788211800.290988:0:6717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a64b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291001:0:6717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a64b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291007:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a64b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211800.291129:0:6717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788211800.291135:0:6717:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788211800.291349:0:6717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a64b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291368:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a64b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291409:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a64a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291417:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a64a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291425:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a64a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291432:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211800.291437:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a64a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291446:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a64a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291467:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211800.291471:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211800.291477:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a64a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291484:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a64a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291496:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a64ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291502:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a64ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291507:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a64ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291524:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211800.291527:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a64ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291533:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a64ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291541:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8abfc9a0d800) 00010000:00010000:2.0:1788211800.291543:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211800.291546:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a64ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291552:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6c00/0x2afbce82f55a64ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291614:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7600/0x2afbce82f55a649d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ba0 expref: 27 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291630:0:6717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a64b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ba0 expref: 26 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211800.291638:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:2.0:1788211800.291641:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211800.291643:0:6717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7c00, rc 0) 00000100:00100000:2.0:1788211800.291745:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:11640:x1875075637805696:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 16785us (17304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211800.291755:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 232 00010000:00010000:2.0:1788211801.255671:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788211801.256821:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788211801.256828:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788211801.256867:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788211801.256873:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788211801.258562:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010c5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1875075660857728:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788211801.258721:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec677bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788211801.265651:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010c5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1875075660857728:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788211801.268494:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211801.269080:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637806208 00000100:00100000:0.0:1788211801.269094:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637806208 00000100:00100000:0.0:1788211801.269202:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 233 00000100:00100000:0.0:1788211801.269214:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:11651:x1875075637806208:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788211801.269253:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788211801.269393:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:11651:x1875075637806208:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 181us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211801.269401:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 233 00000100:00080000:3.0:1788211801.269492:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211801.274484:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211801.274801:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637806464 00000100:00100000:2.0:1788211801.274814:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637806464 00000100:00100000:2.0:1788211801.274885:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 234 00000100:00100000:2.0:1788211801.274897:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+26:11651:x1875075637806464:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788211801.274923:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211801.274945:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a64b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ba7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211801.275080:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a64c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211801.275096:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a64c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211801.275108:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a64c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788211801.275120:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788211801.275291:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c6000/0x2afbce82f55a64b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ba7 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211801.275311:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a64c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ba7 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211801.275319:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:2.0:1788211801.275322:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211801.275327:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7400, rc 0) 00000100:00100000:2.0:1788211801.275391:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:11651:x1875075637806464:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 496us (919us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788211801.275414:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 234 00000100:00100000:1.0:1788211801.284398:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211801.284451:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211801.284485:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637806848 00000100:00100000:1.0:1788211801.284498:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637806848 00000100:00100000:1.0:1788211801.284566:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:1.0:1788211801.284588:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:2359:x1875075637806848:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211801.284605:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211801.284630:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7400/0x2afbce82f55a64c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ba7 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211801.284654:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:1.0:1788211801.284659:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211801.284714:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+27:2359:x1875075637806848:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 139us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211801.284722:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:3.0:1788211801.295574:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637806720 00000100:00100000:3.0:1788211801.295603:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637806720 00000100:00100000:3.0:1788211801.295684:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 235 00000100:00100000:3.0:1788211801.295696:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+27:11651:x1875075637806720:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788211801.295783:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.295802:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.295813:0:6717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.296028:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.296036:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.296606:0:6717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.296616:0:6717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211801.296621:0:6717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.296632:0:6717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.296648:0:6717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211801.296652:0:6717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788211801.296657:0:6717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.296665:0:6717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211801.296854:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:11651:x1875075637806720:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 1157us (12464us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788211801.296864:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 235 00000040:00080000:0.0:1788211801.298322:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788211801.298331:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788211801.298837:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788211801.298850:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788211801.302086:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211801.304214:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637807104 00000100:00100000:2.0:1788211801.304227:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637807104 00000100:00100000:2.0:1788211801.304306:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:2.0:1788211801.304317:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+28:11651:x1875075637807104:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788211801.304600:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+29:11651:x1875075637807104:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 284us (2528us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788211801.304607:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 64 00000040:00080000:0.0:1788211801.345300:0:12629:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788211801.345309:0:12629:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788211801.345363:0:12629:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788211801.345372:0:12629:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788211801.548729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211801.548847:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637807360 00000100:00100000:0.0:1788211801.548861:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637807360 00000100:00100000:0.0:1788211801.548929:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 236 00000100:00100000:0.0:1788211801.548940:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+29:11664:x1875075637807360:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788211801.548968:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211801.548990:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a64d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5bae expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211801.549112:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a64dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211801.549128:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a64dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211801.549140:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a64dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211801.549151:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788211801.549346:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a64d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bae expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211801.549366:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a64dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bae expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211801.549376:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:0.0:1788211801.549379:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788211801.549383:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc800, rc 0) 00000100:00100000:0.0:1788211801.549441:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:11664:x1875075637807360:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 502us (724us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788211801.549450:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 236 00000100:00100000:1.0:1788211801.563583:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211801.567728:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637807488 00000100:00100000:3.0:1788211801.567755:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637807488 00000100:00100000:3.0:1788211801.567857:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 237 00000100:00100000:3.0:1788211801.567871:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:11664:x1875075637807488:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:3.0:1788211801.567954:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.567985:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.568284:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.568319:0:9952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.568327:0:9952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.568334:0:9952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.568341:0:9952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211801.568346:0:9952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.568354:0:9952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.568368:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:3.0:1788211801.568373:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788211801.568378:0:9952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211801.568397:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a64ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211801.568523:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:11664:x1875075637807488:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 652us (4960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211801.568533:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 237 00000100:00100000:1.0:1788211801.731728:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211801.731786:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637807616 00000100:00100000:1.0:1788211801.731795:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637807616 00000100:00100000:1.0:1788211801.731860:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 72 00000100:00100000:1.0:1788211801.731872:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2361:x1875075637807616:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1788211801.731890:0:8290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211801.731911:0:8290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a64f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5bb5 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788211801.731939:0:8290:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a95f256, atime: 0x6a95f256, ctime: 0x6a95f256, blocks: 0xb 00010000:00010000:1.0:1788211801.731959:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=391s v=(0 0) 00010000:00010000:1.0:1788211801.731964:0:8290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211801.731985:0:8290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a64f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bb5 expref: 8 pid: 8290 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211801.732012:0:8290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a64f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bb5 expref: 8 pid: 8290 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211801.732026:0:8290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37ba00, rc 0) 00000100:00100000:1.0:1788211801.732098:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2361:x1875075637807616:12345-192.168.204.29@tcp:101:cat.0 Request processed in 228us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211801.732105:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 72 00000100:00080000:1.0:1788211801.732130:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788211801.738382:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211801.738469:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637807744 00000100:00100000:3.0:1788211801.738481:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637807744 00002000:00100000:3.0:1788211801.738534:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8abec620d180 x1875075637807744/t0(0) o3->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:352/0 lens 488/0 e 0 to 0 dl 1788211812 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211801.738557:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abec620d180 with x1875075637807744 ext(0->4095) 00002000:00010000:3.0:1788211801.738564:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8abec620d180 00000100:00100000:3.0:1788211801.738605:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1788211801.738616:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2360:x1875075637807744:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:3.0:1788211801.738872:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2360:x1875075637807744:12345-192.168.204.29@tcp:3:cat.0 Request processed in 257us (503us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788211801.738882:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00002000:00100000:3.0:1788211801.738890:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8abec620d180 x1875075637807744/t0(0) o3->a688ef06-7eb0-4c47-9425-de9843f5c0e0@192.168.204.29@tcp:352/0 lens 488/4536 e 0 to 0 dl 1788211812 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788211801.738899:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8abec620d180 with x1875075637807744 ext(0->4095) 00002000:00010000:3.0:1788211801.738903:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8abec620d180 00000100:00100000:3.0:1788211801.829597:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788211801.829623:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660857856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211801.829769:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211801.831495:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660857856 00000100:00100000:0.0:1788211801.831511:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660857856 00000100:00100000:0.0:1788211801.831597:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788211801.831610:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875075660857856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788211801.831657:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211801.831747:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875075660857856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211801.831755:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788211801.831945:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660857856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788211802.279669:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211802.343683:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660857984:0@lo:400:kworker.0 00000100:00100000:1.0:1788211802.343756:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660858112:0@lo:400:kworker.0 00000100:00100000:3.0:1788211802.343778:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211802.343805:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211802.343893:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660857984 00000100:00100000:2.0:1788211802.343906:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660857984 00000100:00100000:0.0:1788211802.343949:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660858368:0@lo:400:kworker.0 00000100:00100000:2.0:1788211802.343983:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788211802.344005:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3309:x1875075660857984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211802.344325:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211802.344448:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660858240:0@lo:400:kworker.0 00000100:00100000:3.0:1788211802.344484:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211802.344519:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660858112 00000100:00100000:3.0:1788211802.344523:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660858112 00000100:00100000:3.0:1788211802.344556:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660858368 00000100:00100000:3.0:1788211802.344577:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660858368 00000100:00100000:3.0:1788211802.344607:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660858240 00000100:00100000:3.0:1788211802.344611:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660858240 00000100:00100000:3.0:1788211802.344628:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788211802.344635:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660858112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211802.344643:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211802.344657:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec620d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660858496:0@lo:400:kworker.0 00000100:00100000:3.0:1788211802.344680:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660858112:12345-0@lo:400:kworker.0 Request processed in 45us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211802.344689:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788211802.344698:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211802.344708:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788211802.344717:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec620dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660858368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211802.344757:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788211802.344769:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660858240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211802.344800:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3309:x1875075660857984:12345-0@lo:400:kworker.0 Request processed in 805us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211802.344809:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788211802.344822:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660858240:12345-0@lo:400:kworker.0 Request processed in 54us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211802.344838:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1788211802.344854:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211802.344867:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660858496 00000100:00100000:0.0:1788211802.344872:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660858496 00000100:00100000:2.0:1788211802.344912:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660857984:0@lo:400:kworker.0 00000100:00100000:0.0:1788211802.344918:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788211802.344927:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875075660858496:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788211802.344944:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788211802.344964:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660858240:0@lo:400:kworker.0 00000100:00100000:1.0:1788211802.345000:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660858112:0@lo:400:kworker.0 00000100:00100000:3.0:1788211802.345162:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec620dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660858368:12345-0@lo:400:kworker.0 Request processed in 446us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211802.345191:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788211802.349008:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875075660858496:12345-0@lo:400:kworker.0 Request processed in 4069us (4297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211802.349026:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788211802.354880:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660858496:0@lo:400:kworker.0 00000100:00100000:1.0:1788211802.354904:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec620f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660858368:0@lo:400:kworker.0 00000100:00100000:1.0:1788211802.854207:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788211802.854247:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660858624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211802.854333:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211802.854410:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660858624 00000100:00100000:1.0:1788211802.854418:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660858624 00000100:00100000:1.0:1788211802.854492:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788211802.854505:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875075660858624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788211802.854566:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211802.854622:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875075660858624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211802.854630:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788211802.854687:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660858624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788211803.304342:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211803.353375:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211803.353425:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211803.353461:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211803.353489:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211803.353550:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211803.353593:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637808384 00000100:00100000:1.0:1788211803.353606:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637808384 00000100:00100000:1.0:1788211803.353680:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637808000 00000100:00100000:1.0:1788211803.353683:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637808000 00000100:00100000:1.0:1788211803.353706:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 175 00000100:00100000:1.0:1788211803.353718:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637808384:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211803.353833:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2361:x1875075637808384:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 116us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211803.353842:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 175 00000100:00100000:1.0:1788211803.353868:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 176 00000100:00100000:1.0:1788211803.353874:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:2361:x1875075637808000:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211803.353905:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+31:2361:x1875075637808000:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211803.353910:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 176 00000100:00100000:1.0:1788211803.353931:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637808128 00000100:00100000:1.0:1788211803.353935:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637808128 00000100:00100000:1.0:1788211803.353963:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637808256 00000100:00100000:1.0:1788211803.353967:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637808256 00000100:00100000:1.0:1788211803.353985:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:1.0:1788211803.353992:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2361:x1875075637808128:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211803.354017:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2361:x1875075637808128:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211803.354023:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:1.0:1788211803.354035:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00100000:1.0:1788211803.354041:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2361:x1875075637808256:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211803.354075:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+8:2361:x1875075637808256:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 35us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211803.354082:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00080000:1.0:1788211803.354100:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211803.354104:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788211803.354107:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211803.359156:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637807872 00000100:00100000:0.0:1788211803.359195:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637807872 00000100:00100000:0.0:1788211803.359284:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 303 00000100:00100000:0.0:1788211803.359298:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637807872:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211803.359398:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637807872:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 103us (6039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211803.359407:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 303 00000001:00080000:0.0:1788211803.487647:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1788211803.487707:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:0.0:1788211804.327441:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211805.357878:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788211805.547952:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1788211805.547972:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1788211805.584578:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788211805.584615:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8abfc4ad9b40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788211805.584621:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abff6047800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8abfc4ad9a80 00000020:00080000:3.0:1788211805.584625:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abff6047300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ac00133cc00 00000020:00080000:0.0:1788211805.584668:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:0.0:1788211805.584901:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788211805.586266:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1788211806.373447:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211806.949792:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788211806.949820:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660858752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211806.949913:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211806.950087:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660858752 00000100:00100000:0.0:1788211806.950097:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660858752 00000100:00100000:0.0:1788211806.950160:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788211806.950189:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660858752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788211806.950234:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211806.950297:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660858752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211806.950305:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788211806.950669:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788211806.950704:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788211806.950711:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1788211806.950737:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abffe3b0380, transno 4294967310 00000100:00100000:3.0:1788211806.950766:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660858752:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788211807.398605:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211807.478776:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660858880:0@lo:400:kworker.0 00000100:00100000:1.0:1788211807.478870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211807.478922:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660859392:0@lo:400:kworker.0 00000100:00100000:1.0:1788211807.478949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211807.478981:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211807.478986:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660859008:0@lo:400:kworker.0 00000100:00100000:1.0:1788211807.479068:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211807.479097:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660859264:0@lo:400:kworker.0 00000100:00100000:1.0:1788211807.479122:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211807.479140:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788211807.479146:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660859136:0@lo:400:kworker.0 00000100:00100000:1.0:1788211807.479189:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211807.479218:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660858880 00000100:00100000:1.0:1788211807.479226:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660858880 00000100:00100000:1.0:1788211807.479279:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788211807.479288:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660858880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211807.479336:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afe7852e-b478-4e21-8864-7e739fb0a137+19:3308:x1875075660858880:12345-0@lo:400:kworker.0 Request processed in 48us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211807.479343:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788211807.479387:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660859008 00000100:00100000:1.0:1788211807.479391:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660859008 00000100:00100000:1.0:1788211807.479415:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660859264 00000100:00100000:1.0:1788211807.479418:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660859264 00000100:00100000:1.0:1788211807.479443:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660859136 00000100:00100000:1.0:1788211807.479445:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660859136 00000100:00100000:1.0:1788211807.479471:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788211807.479477:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660859008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211807.479510:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660859008:12345-0@lo:400:kworker.0 Request processed in 33us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211807.479516:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788211807.479528:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788211807.479534:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660859264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211807.479564:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660859264:12345-0@lo:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211807.479569:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788211807.479583:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788211807.479588:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660859136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211807.479615:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660859136:12345-0@lo:400:kworker.0 Request processed in 27us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211807.479621:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788211807.479663:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660859136:0@lo:400:kworker.0 00000100:00100000:1.0:1788211807.479673:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660859264:0@lo:400:kworker.0 00000100:00100000:1.0:1788211807.479701:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660859008:0@lo:400:kworker.0 00000100:00100000:1.0:1788211807.479710:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660858880:0@lo:400:kworker.0 00000100:00080000:3.0:1788211807.480507:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211807.481021:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660859392 00000100:00100000:0.0:1788211807.481032:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660859392 00000100:00100000:0.0:1788211807.481100:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788211807.481109:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660859392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211807.481207:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660859392:12345-0@lo:400:kworker.0 Request processed in 100us (2256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211807.481214:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1788211807.481239:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788211807.481276:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788211807.481281:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abfef635180, transno 4294967322 00000004:00080000:0.0:1788211807.481292:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788211807.481310:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660859392:0@lo:400:kworker.0 00000100:00100000:2.0:1788211807.866340:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211807.870100:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637808512 00000100:00100000:1.0:1788211807.870123:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637808512 00000100:00100000:1.0:1788211807.870330:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 238 00000100:00100000:1.0:1788211807.870344:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:11316:x1875075637808512:12345-192.168.204.29@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788211807.870566:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:11316:x1875075637808512:12345-192.168.204.29@tcp:60:lhsmtool_posix.0 Request processed in 224us (4236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211807.870575:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 238 00000100:00080000:0.0:1788211807.874670:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211807.885086:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211807.885417:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637808768 00000100:00100000:2.0:1788211807.885427:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637808768 00000100:00100000:2.0:1788211807.885531:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:2.0:1788211807.885542:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:11316:x1875075637808768:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788211807.886150:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:11316:x1875075637808768:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 608us (1077us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788211807.886158:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:2.0:1788211807.974332:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660859520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211807.974410:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211807.974503:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660859520 00000100:00100000:3.0:1788211807.974514:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660859520 00000100:00100000:3.0:1788211807.974580:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788211807.974591:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660859520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211807.974640:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211807.977220:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660859520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2617us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211807.977238:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788211807.978241:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660859520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211808.125908:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211808.126055:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637808896 00000100:00100000:1.0:1788211808.126065:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637808896 00000100:00100000:1.0:1788211808.126148:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 239 00000100:00100000:1.0:1788211808.126160:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd57119c-37bb-4375-96c6-4462114b4b2c+5:12116:x1875075637808896:12345-192.168.204.29@tcp:101:lsof.0 00010000:00010000:1.0:1788211808.126206:0:9952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211808.126229:0:9952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a64f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5bbc expref: -99 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211808.126297:0:9952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a64ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211808.126309:0:9952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a64ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211808.126323:0:9952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a64ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211808.126528:0:9952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788211808.126532:0:9952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1788211808.126607:0:9952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a64ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788211808.126703:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788211808.126918:0:9952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37aa00/0x2afbce82f55a64f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bbc expref: 7 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211808.126936:0:9952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a64ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bbc expref: 6 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211808.126945:0:9952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:1.0:1788211808.126948:0:9952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788211808.126951:0:9952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b400, rc 0) 00000100:00100000:1.0:1788211808.127023:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd57119c-37bb-4375-96c6-4462114b4b2c+6:12116:x1875075637808896:12345-192.168.204.29@tcp:101:lsof.0 Request processed in 865us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211808.127031:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 239 00010000:00010000:0.0:1788211808.424323:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211808.483278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211808.483331:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211808.483364:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211808.483418:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637809024 00000100:00100000:3.0:1788211808.483434:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637809024 00000100:00100000:3.0:1788211808.483507:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 305 00000100:00100000:3.0:1788211808.483517:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637809024:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211808.483604:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2359:x1875075637809024:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 89us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211808.483612:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 305 00000100:00100000:0.0:1788211808.483710:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637809152 00000100:00100000:0.0:1788211808.483716:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637809152 00000100:00100000:0.0:1788211808.483795:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637809280 00000100:00100000:0.0:1788211808.483798:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637809280 00000100:00100000:0.0:1788211808.483824:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:0.0:1788211808.483833:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637809152:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211808.483900:0:12590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 89 00000100:00100000:1.0:1788211808.483910:0:12590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637809280:12345-192.168.204.29@tcp:400:kworker.0 00000100:00080000:3.0:1788211808.483922:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788211808.483929:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788211808.485401:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2359:x1875075637809152:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 1555us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211808.485418:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:1.0:1788211808.495505:0:12590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2359:x1875075637809280:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 11574us (12116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211808.495522:0:12590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 89 00010000:00010000:0.0:1788211809.445446:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211810.472759:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788211810.534579:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788211810.534588:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788211810.538300:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1788211810.538319:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:00080000:0.0:1788211810.595940:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788211810.595986:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788211810.596003:0:5876:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1788211810.597109:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00010000:00010000:2.0:1788211811.496048:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211812.072151:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660859648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211812.072262:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211812.072401:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660859648 00000100:00100000:0.0:1788211812.072409:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660859648 00000100:00100000:0.0:1788211812.072484:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788211812.072496:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660859648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788211812.072544:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211812.072614:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660859648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211812.072622:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788211812.072705:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660859648:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788211812.073221:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788211812.307151:0:12834:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 17:30:09 (1788211809) 00010000:00010000:1.0:1788211812.531067:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211812.592078:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660859776:0@lo:400:kworker.0 00000100:00100000:3.0:1788211812.592262:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211812.592326:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdf30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660860288:0@lo:400:kworker.0 00000100:00100000:3.0:1788211812.592370:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211812.592398:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788211812.592404:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdf31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660860160:0@lo:400:kworker.0 00000100:00100000:3.0:1788211812.592429:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211812.592455:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660859904:0@lo:400:kworker.0 00000100:00100000:3.0:1788211812.592479:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211812.592494:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788211812.592499:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660860032:0@lo:400:kworker.0 00000100:00100000:3.0:1788211812.592517:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211812.592818:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660859776 00000100:00100000:3.0:1788211812.592827:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660859776 00000100:00100000:3.0:1788211812.593062:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788211812.593075:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660859776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211812.593614:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660859776:12345-0@lo:400:kworker.0 Request processed in 539us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211812.593625:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788211812.593671:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660860288 00000100:00100000:3.0:1788211812.593677:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660860288 00000100:00100000:3.0:1788211812.593733:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788211812.593741:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660860288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211812.593778:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660860288:12345-0@lo:400:kworker.0 Request processed in 39us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211812.593785:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788211812.593805:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660860160 00000100:00100000:3.0:1788211812.593809:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660860160 00000100:00100000:3.0:1788211812.593834:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660859904 00000100:00100000:3.0:1788211812.593837:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660859904 00000100:00100000:3.0:1788211812.593931:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660860032 00000100:00100000:3.0:1788211812.593935:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660860032 00000100:00100000:3.0:1788211812.594027:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788211812.594036:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00107f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660860160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211812.594071:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00107f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660860160:12345-0@lo:400:kworker.0 Request processed in 36us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211812.594077:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788211812.594089:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788211812.594095:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660859904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211812.594123:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660859904:12345-0@lo:400:kworker.0 Request processed in 28us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211812.594128:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788211812.594139:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788211812.594218:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660859776:0@lo:400:kworker.0 00000100:00100000:2.0:1788211812.594240:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdf30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660860288:0@lo:400:kworker.0 00000100:00100000:2.0:1788211812.594264:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdf31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660860160:0@lo:400:kworker.0 00000100:00100000:3.0:1788211812.594345:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660860032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211812.594391:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660860032:12345-0@lo:400:kworker.0 Request processed in 246us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211812.594397:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:3.0:1788211812.594442:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788211812.594453:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788211812.594485:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660860032:0@lo:400:kworker.0 00000100:00100000:3.0:1788211812.594496:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660859904:0@lo:400:kworker.0 00000100:00100000:3.0:1788211813.100405:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660860416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211813.100486:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211813.100953:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660860416 00000100:00100000:2.0:1788211813.100965:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660860416 00000100:00100000:2.0:1788211813.101028:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788211813.101038:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660860416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211813.101080:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211813.102836:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660860416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1786us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211813.102850:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788211813.103570:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660860416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788211813.544992:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211813.595838:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211813.595904:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211813.595937:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211813.595973:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211813.595998:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211813.596032:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637809664 00000100:00100000:0.0:1788211813.596032:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637809920 00000100:00100000:1.0:1788211813.596041:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637809664 00000100:00100000:0.0:1788211813.596041:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637809920 00000100:00100000:2.0:1788211813.596093:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637809792 00000100:00100000:2.0:1788211813.596098:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637809792 00000100:00100000:0.0:1788211813.596103:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637809536 00000100:00100000:0.0:1788211813.596106:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637809536 00000100:00100000:3.0:1788211813.596156:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637809408 00000100:00100000:3.0:1788211813.596160:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637809408 00000100:00100000:3.0:1788211813.596223:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 307 00000100:00100000:3.0:1788211813.596233:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2360:x1875075637809408:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211813.596327:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2360:x1875075637809408:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 95us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211813.596336:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 307 00000100:00100000:3.0:1788211813.596390:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 183 00000100:00100000:3.0:1788211813.596398:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+6:2360:x1875075637809920:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211813.596432:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd57119c-37bb-4375-96c6-4462114b4b2c+6:2360:x1875075637809920:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 34us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211813.596441:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 183 00000100:00100000:1.0:1788211813.601920:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 91 00000100:00100000:1.0:1788211813.601941:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2360:x1875075637809664:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211813.602040:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2360:x1875075637809664:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 107us (6135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211813.602049:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 91 00000100:00100000:0.0:1788211813.603880:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 184 00000100:00100000:0.0:1788211813.603896:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:2360:x1875075637809536:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211813.603988:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:2360:x1875075637809536:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 97us (8013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211813.603996:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 184 00000100:00100000:2.0:1788211813.608985:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 92 00000100:00100000:2.0:1788211813.609005:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2360:x1875075637809792:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211813.609097:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2360:x1875075637809792:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 98us (13096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211813.609105:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 92 00000100:00080000:3.0:1788211813.611845:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788211813.611855:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788211813.611858:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788211814.565541:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211815.590949:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211816.614853:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211816.940141:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211816.940339:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637810176 00000100:00100000:0.0:1788211816.940350:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637810176 00000100:00100000:0.0:1788211816.940423:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00100000:0.0:1788211816.940434:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+18:12338:x1875075637810176:12345-192.168.204.29@tcp:35:umount.0 00000100:00100000:0.0:1788211816.941082:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:12338:x1875075637810176:12345-192.168.204.29@tcp:35:umount.0 Request processed in 646us (950us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788211816.941090:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00080000:3.0:1788211816.941357:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788211816.949111:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211816.949349:0:12483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637810432 00000100:00100000:3.0:1788211816.949360:0:12483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637810432 00000100:00100000:3.0:1788211816.949438:0:12483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 67 00000100:00100000:3.0:1788211816.949450:0:12483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+19:12338:x1875075637810432:12345-192.168.204.29@tcp:35:umount.0 00000100:00100000:3.0:1788211816.949921:0:12483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:12338:x1875075637810432:12345-192.168.204.29@tcp:35:umount.0 Request processed in 472us (817us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788211816.949930:0:12483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 67 00000100:00100000:1.0:1788211816.954124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211816.954410:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637810688 00000100:00100000:2.0:1788211816.954421:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637810688 00000100:00100000:2.0:1788211816.954484:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:2.0:1788211816.954496:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc64fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+20:12338:x1875075637810688:12345-192.168.204.29@tcp:35:umount.0 00000100:00100000:2.0:1788211816.955299:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc64fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:12338:x1875075637810688:12345-192.168.204.29@tcp:35:umount.0 Request processed in 801us (1185us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788211816.955309:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:1.0:1788211816.969329:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211816.974984:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637810944 00000100:00100000:0.0:1788211816.975001:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637810944 00000100:00100000:0.0:1788211816.975815:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:0.0:1788211816.975836:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+21:12338:x1875075637810944:12345-192.168.204.29@tcp:35:umount.0 00000100:00100000:0.0:1788211816.976314:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:12338:x1875075637810944:12345-192.168.204.29@tcp:35:umount.0 Request processed in 486us (6994us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788211816.976322:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:0.0:1788211816.990943:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211816.990989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211816.991130:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211816.992358:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211816.992850:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637811712 00000100:00100000:0.0:1788211816.992862:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637811712 00000100:00100000:0.0:1788211816.992956:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:0.0:1788211816.992969:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2357:x1875075637811712:12345-192.168.204.29@tcp:9:umount.0 00000020:00000080:0.0:1788211816.993014:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a5ab0 00000020:00010000:0.0:1788211816.993025:0:6693:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8abffe3d5000: total 0 00000100:00080000:0.0:1788211816.993032:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8abffe3d4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788211816.993335:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788211816.993841:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2357:x1875075637811712:12345-192.168.204.29@tcp:9:umount.0 Request processed in 870us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211816.993851:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 73 00000020:00010000:0.0:1788211816.996323:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8abffe3d5000: total 0 00010000:00010000:0.0:1788211816.996389:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8abffe3d5000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788211816.996457:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000479a874f/0x2afbce82f55a5e53 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59e7 expref: 4 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211816.997219:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637811072 00000100:00100000:2.0:1788211816.997231:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637811072 00000100:00100000:2.0:1788211816.997298:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637811328 00000100:00100000:2.0:1788211816.997301:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637811328 00000100:00100000:2.0:1788211816.997315:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637811200 00000100:00100000:2.0:1788211816.997317:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637811200 00000100:00100000:2.0:1788211816.997334:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:2.0:1788211816.997343:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+15:2361:x1875075637811072:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211816.997359:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211816.997373:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a5577 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5747 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211816.997385:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211816.997468:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+14:2361:x1875075637811072:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 125us (6535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211816.997477:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:2.0:1788211816.997765:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:2.0:1788211816.997773:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc59dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+13:2361:x1875075637811328:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211816.997781:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211816.997791:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb81400/0x2afbce82f55a578b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5812 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211816.997801:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211816.997819:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc59dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:2361:x1875075637811328:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 49us (6831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211816.997826:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:2.0:1788211816.997942:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:2.0:1788211816.997951:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:2361:x1875075637811200:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211816.997959:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211816.997969:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a54dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f570f expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211816.997979:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211816.997998:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2361:x1875075637811200:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 49us (6870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211816.998004:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00010000:00010000:0.0:1788211816.998286:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000814e5fa7/0x2afbce82f55a64f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bb5 expref: 3 pid: 8290 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211816.998316:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8abffe3d5000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788211816.998344:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211816.998346:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211816.998348:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788211816.999397:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788211817.003546:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211817.003622:0:12590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637811840 00000100:00100000:2.0:1788211817.003633:0:12590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637811840 00000100:00100000:2.0:1788211817.003715:0:12590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 74 00000100:00100000:2.0:1788211817.003742:0:12590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+5:2357:x1875075637811840:12345-192.168.204.29@tcp:9:umount.0 00000020:00000080:2.0:1788211817.003774:0:12590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a584f 00000100:00080000:2.0:1788211817.003783:0:12590:0:(import.c:65:import_set_state_nolock()) ffff8abffe3d5800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788211817.003832:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1788211817.013898:0:12590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788211817.014623:0:12590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+2:2357:x1875075637811840:12345-192.168.204.29@tcp:9:umount.0 Request processed in 10872us (11076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211817.014638:0:12590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 74 00010000:00010000:1.0:1788211817.016690:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211817.025912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211817.026135:0:9952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637812864 00000100:00100000:3.0:1788211817.026148:0:9952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637812864 00000100:00100000:3.0:1788211817.026260:0:9952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 240 00000100:00100000:3.0:1788211817.026283:0:9952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+22:2357:x1875075637812864:12345-192.168.204.29@tcp:39:umount.0 00000020:00000080:3.0:1788211817.026330:0:9952:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a54eb 00000020:00010000:3.0:1788211817.026354:0:9952:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8abec67d2800: total 0 00000100:00080000:3.0:1788211817.026359:0:9952:0:(import.c:65:import_set_state_nolock()) ffff8abec67d4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788211817.026396:0:9952:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1788211817.026588:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8abec67d2800: total 0 00010000:00010000:2.0:1788211817.026593:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211817.026642:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8abec67d2800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788211817.026681:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:2.0:1788211817.026685:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211817.026701:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a5eb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a03 expref: 21 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026720:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:2.0:1788211817.026723:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788211817.026726:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a64dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bae expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026737:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211817.026740:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211817.026743:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a000/0x2afbce82f55a5e14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59d2 expref: 19 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026755:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:2.0:1788211817.026758:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211817.026761:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7c00/0x2afbce82f55a64b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ba0 expref: 18 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026773:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:2.0:1788211817.026775:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788211817.026795:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a5b12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f590e expref: 17 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026808:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8abfc9a0de00) 00010000:00010000:2.0:1788211817.026810:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211817.026813:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80a00/0x2afbce82f55a57b5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5820 expref: 16 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026830:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211817.026832:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788211817.026836:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063a00/0x2afbce82f55a5e3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f59e0 expref: 15 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026846:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211817.026848:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788211817.026852:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abff63c7200/0x2afbce82f55a61b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5adc expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026862:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8abfc37ec400) 00010000:00010000:2.0:1788211817.026864:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788211817.026867:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a5825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f583c expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026889:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8abfc5bbe000) 00010000:00010000:2.0:1788211817.026892:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788211817.026895:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062800/0x2afbce82f55a63d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5b68 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026909:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8abfc5bbe800) 00010000:00010000:2.0:1788211817.026916:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788211817.026920:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062600/0x2afbce82f55a5ed1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5a0a expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026934:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:2.0:1788211817.026937:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788211817.026940:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37a800/0x2afbce82f55a5d34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f599a expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026955:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfc9a0db00) 00010000:00010000:2.0:1788211817.026957:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211817.026961:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a57d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5827 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211817.026972:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8abec67d2800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788211817.026983:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211817.026985:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211817.026987:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211817.028916:0:9952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a688ef06-7eb0-4c47-9425-de9843f5c0e0+7:2357:x1875075637812864:12345-192.168.204.29@tcp:39:umount.0 Request processed in 2633us (3004us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788211817.028930:0:9952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 240 00000100:00100000:3.0:1788211817.190632:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788211817.190664:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660860544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211817.190761:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211817.191066:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660860544 00000100:00100000:0.0:1788211817.191077:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660860544 00000100:00100000:0.0:1788211817.191144:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788211817.191155:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660860544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788211817.191219:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211817.191290:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660860544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211817.191299:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788211817.191347:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660860544:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788211817.191782:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788211817.637748:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211817.702429:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660860672:0@lo:400:kworker.0 00000100:00100000:3.0:1788211817.702539:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211817.702697:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660860672 00000100:00100000:2.0:1788211817.702707:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660860672 00000100:00100000:2.0:1788211817.702753:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788211817.702763:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660860672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211817.704826:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660860800:0@lo:400:kworker.0 00000100:00100000:1.0:1788211817.704898:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211817.704951:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660860800 00000100:00100000:1.0:1788211817.704959:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660860800 00000100:00100000:1.0:1788211817.705002:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788211817.705009:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660860800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211817.705052:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660860800:12345-0@lo:400:kworker.0 Request processed in 43us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211817.705059:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788211817.705112:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660860800:0@lo:400:kworker.0 00000100:00100000:2.0:1788211817.708014:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3310:x1875075660860672:12345-0@lo:400:kworker.0 Request processed in 5240us (5463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211817.708041:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788211817.710096:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660861056:0@lo:400:kworker.0 00000100:00100000:0.0:1788211817.710209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211817.710269:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788211817.710275:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660860928:0@lo:400:kworker.0 00000100:00100000:0.0:1788211817.710304:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211817.710342:0:8290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660861056 00000100:00100000:0.0:1788211817.710349:0:8290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660861056 00000100:00100000:0.0:1788211817.710399:0:8290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788211817.710409:0:8290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660861056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211817.710469:0:8290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660861056:12345-0@lo:400:kworker.0 Request processed in 61us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211817.710476:0:8290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788211817.710504:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660860928 00000100:00100000:0.0:1788211817.710507:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660860928 00000100:00100000:0.0:1788211817.710548:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788211817.710554:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660860928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211817.710585:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660860928:12345-0@lo:400:kworker.0 Request processed in 31us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211817.710591:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788211817.710653:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660860928:0@lo:400:kworker.0 00000100:00100000:0.0:1788211817.711237:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660861056:0@lo:400:kworker.0 00000100:00080000:0.0:1788211817.711278:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211817.711291:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660861312:0@lo:400:kworker.0 00000100:00100000:0.0:1788211817.711328:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211817.711354:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788211817.711360:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660861184:0@lo:400:kworker.0 00000100:00100000:0.0:1788211817.711382:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211817.711424:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660861312 00000100:00100000:0.0:1788211817.711429:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660861312 00000100:00100000:0.0:1788211817.711466:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788211817.711474:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660861312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211817.711513:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660861312:12345-0@lo:400:kworker.0 Request processed in 41us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211817.711519:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788211817.711538:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660861184 00000100:00100000:0.0:1788211817.711541:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660861184 00000100:00100000:0.0:1788211817.711567:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788211817.711574:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660861184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211817.711602:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660861184:12345-0@lo:400:kworker.0 Request processed in 28us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211817.711608:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1788211817.711620:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788211817.711623:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788211817.711642:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660861184:0@lo:400:kworker.0 00000100:00100000:0.0:1788211817.711651:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660861312:0@lo:400:kworker.0 00000100:00100000:3.0:1788211817.713955:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660860672:0@lo:400:kworker.0 00000100:00100000:2.0:1788211818.213851:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660861440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211818.213943:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211818.214095:0:8635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660861440 00000100:00100000:3.0:1788211818.214105:0:8635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660861440 00000100:00100000:3.0:1788211818.214156:0:8635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788211818.214186:0:8635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660861440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211818.214220:0:8635:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211818.214292:0:8635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660861440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211818.214300:0:8635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788211818.214640:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660861440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788211818.408277:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211818.408318:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211818.408428:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211818.421043:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211818.421119:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637813504 00000100:00100000:0.0:1788211818.421132:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637813504 00000100:00100000:0.0:1788211818.421221:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 241 00000100:00100000:2.0:1788211818.421223:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637812992 00000100:00100000:2.0:1788211818.421228:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637812992 00000100:00100000:0.0:1788211818.421232:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+6:2357:x1875075637813504:12345-192.168.204.29@tcp:39:umount.0 00000020:00000080:0.0:1788211818.421292:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a55d2 00000100:00100000:2.0:1788211818.421305:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637813248 00000100:00100000:2.0:1788211818.421309:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637813248 00000020:00010000:0.0:1788211818.421320:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8abfca9e4000: total 0 00000100:00100000:2.0:1788211818.421321:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637813120 00000100:00100000:2.0:1788211818.421324:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637813120 00000100:00080000:0.0:1788211818.421327:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8abfca9e6000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788211818.421338:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:2.0:1788211818.421347:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+12:2359:x1875075637812992:12345-192.168.204.29@tcp:103:ldlm_bl.0 00000001:00000004:0.0:1788211818.421357:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:2.0:1788211818.421360:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211818.421382:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b07800/0x2afbce82f55a55bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f575c expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211818.421401:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211818.421468:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+11:2359:x1875075637812992:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 123us (13204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211818.421477:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:2.0:1788211818.421497:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1788211818.421503:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+10:2359:x1875075637813248:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211818.421511:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211818.421520:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfca8cc200/0x2afbce82f55a5784 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f580b expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211818.421530:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211818.421546:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+9:2359:x1875075637813248:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 43us (13228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211818.421552:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1788211818.421563:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:2.0:1788211818.421576:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+8:2359:x1875075637813120:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211818.421584:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211818.421593:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b07000/0x2afbce82f55a55c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5786 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211818.421601:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211818.421618:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd57119c-37bb-4375-96c6-4462114b4b2c+5:2357:x1875075637813504:12345-192.168.204.29@tcp:39:umount.0 Request processed in 388us (589us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788211818.421622:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+7:2359:x1875075637813120:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 48us (13206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211818.421626:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 241 00000100:00100000:2.0:1788211818.421628:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 22 00000020:00010000:2.0:1788211818.421644:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8abfca9e4000: total 0 00000100:00080000:0.0:1788211818.421647:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788211818.423337:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8abfca9e4000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788211818.423387:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfc5bbe500) 00010000:00010000:2.0:1788211818.423391:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788211818.423403:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfcb37b400/0x2afbce82f55a64ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bbc expref: 4 pid: 9952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211818.423428:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8abfca9e4000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788211818.423440:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211818.423441:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211818.423444:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211818.478347:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211818.478461:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637813760 00000100:00100000:2.0:1788211818.478473:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637813760 00000100:00100000:2.0:1788211818.478537:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 309 00000100:00100000:2.0:1788211818.478549:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd8745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+7:2357:x1875075637813760:12345-192.168.204.29@tcp:251:umount.0 00000020:00000080:2.0:1788211818.478600:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a54c8 00000020:00010000:2.0:1788211818.478609:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8abfff89e800: total 0 00000100:00080000:2.0:1788211818.478614:0:5835:0:(import.c:65:import_set_state_nolock()) ffff8abec6690000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788211818.478710:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd8745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab+3:2357:x1875075637813760:12345-192.168.204.29@tcp:251:umount.0 Request processed in 163us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211818.478739:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 309 00000020:00010000:3.0:1788211818.479000:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8abfff89e800: total 0 00010000:00010000:3.0:1788211818.479005:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211818.479049:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8abfff89e800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788211818.479091:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b06e00/0x2afbce82f55a557e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f574e expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211818.479106:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8abfff89e800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788211818.479116:0:5832:0:(genops.c:885:class_export_put()) final put ffff8abfff89e800/d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab 00010000:00010000:3.0:1788211818.479135:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211818.479137:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211818.479139:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788211818.479303:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfff89e800/d5782dc5-2d15-4f7c-8fed-e28e3b6c73ab for MGS 00000020:00000080:2.0:1788211818.479334:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec6690000 for MGS 00010000:00010000:2.0:1788211818.662508:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788211818.878008:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000020:00000080:1.0:1788211818.878019:0:6720:0:(genops.c:885:class_export_put()) final put ffff8abffe3d0800/a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000020:00000080:0.0:1788211818.878141:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abffe3d0800/a688ef06-7eb0-4c47-9425-de9843f5c0e0 for lustre-OST0000 00000020:00000080:0.0:1788211818.878226:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abffe3d5800 for lustre-OST0000 00010000:00010000:3.0:1788211819.685819:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788211820.234814:0:13032:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788211820.258421:0:13032:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788211820.258475:0:13032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.258490:0:13032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.258517:0:13032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.258524:0:13032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.258548:0:13032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788211820.258554:0:13032:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788211820.258584:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788211820.258590:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788211820.258598:0:13032:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788211820.258627:0:13032:0:(import.c:65:import_set_state_nolock()) ffff8abfefb1d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788211820.258665:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211820.258671:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.258685:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0031e00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211820.258689:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.258698:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211820.258706:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211820.258716:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788211820.258718:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788211820.258728:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788211820.258758:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.258764:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211820.258783:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.258789:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a554d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a5554 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.258801:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211820.258802:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211820.258804:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211820.258821:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660861696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788211820.258897:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211820.258984:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660861568:0@lo:39:umount.0 00000100:00100000:3.0:1788211820.259297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211820.259403:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660861568 00000100:00100000:3.0:1788211820.259411:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660861568 00000100:00100000:3.0:1788211820.259462:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788211820.259473:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875075660861568:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788211820.259504:0:6717:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a52e5 00000100:00080000:3.0:1788211820.259514:0:6717:0:(import.c:65:import_set_state_nolock()) ffff8abfefb0a800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788211820.259574:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3307:x1875075660861568:12345-0@lo:39:umount.0 Request processed in 102us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211820.259583:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788211820.259592:0:6717:0:(genops.c:885:class_export_put()) final put ffff8abfefb0e000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788211820.259617:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788211820.259660:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfefb1d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788211820.259671:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660861568:0@lo:39:umount.0 00000100:00080000:3.0:1788211820.259698:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788211820.259701:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788211820.259705:0:13032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1788211820.261303:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660861696 00000100:00100000:2.0:1788211820.261320:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660861696 00000100:00100000:2.0:1788211820.261400:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788211820.261411:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afe7852e-b478-4e21-8864-7e739fb0a137+19:3309:x1875075660861696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788211820.261427:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211820.261452:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a5554 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a554d expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.261675:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211820.261826:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afe7852e-b478-4e21-8864-7e739fb0a137+18:3309:x1875075660861696:12345-0@lo:103:ldlm_bl.0 Request processed in 413us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211820.261842:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:00000080:2.0:1788211820.261901:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb0e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788211820.261998:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfefb0a800 for lustre-MDT0000 00000100:00100000:1.0:1788211820.262442:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660861696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788211820.262761:0:13032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.262773:0:13032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.262782:0:13032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.262820:0:13032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.262856:0:13032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211820.262870:0:13032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.262882:0:13032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.262895:0:13032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.262904:0:13032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.262927:0:13032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788211820.262942:0:13032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.262953:0:13032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.262963:0:13032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.262973:0:13032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.263005:0:13032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788211820.263015:0:13032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4e00/0x2afbce82f55a5236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.263093:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788211820.263101:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.263110:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07a00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211820.263114:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.263123:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211820.263130:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211820.263137:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788211820.263140:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788211820.263197:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788211820.263420:0:13033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788211820.263428:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211820.263436:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b000 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788211820.263439:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211820.263450:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788211820.263459:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211820.263464:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788211820.263466:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788211820.263470:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788211820.263493:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211820.263503:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788211820.263546:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211820.263580:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a5482 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a5489 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211820.263606:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211820.263610:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211820.263612:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211820.263625:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788211820.263650:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660861824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788211820.263737:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788211820.263811:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.263819:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211820.263840:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.263848:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a555b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a5562 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.263870:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211820.263872:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211820.263874:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211820.263880:0:13032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4e00/0x2afbce82f55a5236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211820.263881:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788211820.263896:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660861952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788211820.263897:0:13032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4e00/0x2afbce82f55a5236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211820.263913:0:13032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4e00/0x2afbce82f55a5236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211820.263936:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211820.263949:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660861824 00000100:00100000:2.0:1788211820.263962:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660861824 00000100:00100000:3.0:1788211820.263975:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660861952 00000100:00100000:3.0:1788211820.263981:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660861952 00000100:00100000:3.0:1788211820.264084:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788211820.264094:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+19:3311:x1875075660861824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211820.264108:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211820.264124:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a5489 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a5482 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211820.264125:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788211820.264139:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788211820.264145:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211820.264203:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+18:3311:x1875075660861824:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211820.264222:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788211820.264294:0:13032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788211820.264299:0:13032:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788211820.264303:0:13032:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788211820.264334:0:13032:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788211820.264338:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788211820.264344:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788211820.264350:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1788211820.264357:0:13032:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8abec6691800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788211820.264364:0:13032:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8abfca9d6800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788211820.264373:0:13032:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8abfca9e4000 cd57119c-37bb-4375-96c6-4462114b4b2c 192.168.204.29@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788211820.264379:0:13032:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8abec67d2800 a688ef06-7eb0-4c47-9425-de9843f5c0e0 192.168.204.29@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:2.0:1788211820.264391:0:13032:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8abfc540cd28) has exports, disconnecting them 00000020:00080000:2.0:1788211820.264397:0:13032:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8abec6691800), last request at 1788211817 00000020:00000080:2.0:1788211820.264403:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a544a 00000100:00080000:2.0:1788211820.264421:0:13032:0:(import.c:65:import_set_state_nolock()) ffff8abec6693000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788211820.264469:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788211820.264479:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc58b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+17:3310:x1875075660861952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211820.264489:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211820.264500:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb81e00/0x2afbce82f55a5562 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a555b expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.264510:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:2.0:1788211820.264521:0:13032:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8abec6691800): rc 0 00000020:00000080:2.0:1788211820.264530:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abec6691800/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:3.0:1788211820.264543:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc58b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+16:3310:x1875075660861952:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (607us total) trans 0 rc 0/0 00000020:00080000:2.0:1788211820.264552:0:13032:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8abfca9d6800), last request at 1788211817 00000100:00100000:3.0:1788211820.264560:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:2.0:1788211820.264565:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a537f 00000100:00080000:2.0:1788211820.264579:0:13032:0:(import.c:65:import_set_state_nolock()) ffff8abfca9d2000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788211820.264600:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec6691800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1788211820.264634:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afe7852e-b478-4e21-8864-7e739fb0a137:3310:1875075660861952:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211820.264657:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211820.264662:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4e00/0x2afbce82f55a5236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788211820.264668:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec6693000 for lustre-MDT0000 00010000:00010000:3.0:1788211820.264670:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4e00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211820.264677:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4e00/0x2afbce82f55a5236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.264685:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4e00/0x2afbce82f55a5236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211820.264692:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4e00/0x2afbce82f55a5236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211820.264698:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788211820.264702:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000020:00080000:2.0:1788211820.264702:0:13032:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8abfca9d6800): rc 0 10000000:01000000:3.0:1788211820.264707:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:2.0:1788211820.264712:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfca9d6800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1788211820.264727:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4e00/0x2afbce82f55a5236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:2.0:1788211820.264733:0:13032:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa765c1db3ae0 00010000:00010000:3.0:1788211820.264735:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:2.0:1788211820.264748:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfca9d6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1788211820.264754:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4e00/0x2afbce82f55a5236 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.264762:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4e00/0x2afbce82f55a5236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a523d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788211820.264778:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfca9d2000 for lustre-MDT0000 00010000:00010000:3.0:1788211820.264786:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211820.264790:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211820.264792:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211820.264807:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660862080:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788211820.264809:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788211820.264817:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000100:00100000:3.0:1788211820.264840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788211820.264841:0:13032:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788211820.264884:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660862080 00000100:00100000:3.0:1788211820.264889:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660862080 00000100:00100000:3.0:1788211820.264920:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788211820.264927:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afe7852e-b478-4e21-8864-7e739fb0a137+16:3308:x1875075660862080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211820.264934:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211820.264945:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac0020c1400/0x2afbce82f55a523d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a5236 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211820.264957:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211820.264986:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afe7852e-b478-4e21-8864-7e739fb0a137+15:3308:x1875075660862080:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211820.264993:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788211820.265005:0:13032:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788211820.265035:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afe7852e-b478-4e21-8864-7e739fb0a137:3308:1875075660862080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788211820.265281:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660861824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788211820.265305:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788211820.265466:0:13032:0:(import.c:65:import_set_state_nolock()) ffff8abfd86dd000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788211820.265501:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788211820.265505:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788211820.265595:0:13032:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788211820.265735:0:13032:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788211820.265748:0:13032:0:(import.c:65:import_set_state_nolock()) ffff8abec5af8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788211820.265802:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8abfc540cd28) has no exports 00000100:00100000:3.0:1788211820.265903:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660862208:0@lo:9:umount.0 00000100:00100000:3.0:1788211820.265951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211820.265978:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660862336:0@lo:9:umount.0 00000100:00100000:3.0:1788211820.266566:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211820.266614:0:12590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660862208 00000100:00100000:3.0:1788211820.266621:0:12590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660862208 00000100:00080000:1.0:1788211820.266726:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788211820.266757:0:12590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660862336 00000100:00100000:3.0:1788211820.266771:0:12590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660862336 00000100:00100000:3.0:1788211820.266885:0:12590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788211820.266894:0:12590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875075660862208:12345-0@lo:9:umount.0 00000100:00080000:1.0:1788211820.266910:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1788211820.266921:0:12590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a53cc 00000100:00080000:3.0:1788211820.266930:0:12590:0:(import.c:65:import_set_state_nolock()) ffff8abec5ade800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788211820.266967:0:12590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1788211820.266975:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211820.267089:0:13034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211820.267093:0:13034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211820.267095:0:13034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211820.267157:0:13033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211820.267230:0:13033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07400 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788211820.267234:0:13033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211820.267244:0:13033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788211820.267252:0:13033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211820.267257:0:13033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788211820.267260:0:13033:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788211820.267270:0:13033:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1788211820.267385:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788211820.267396:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875075660862336:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788211820.267412:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a54b3 00000100:00080000:2.0:1788211820.267420:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8abfcaf31800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788211820.267469:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:0.0:1788211820.267587:0:13033:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211820.267595:0:13033:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211820.267616:0:13033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211820.267624:0:13033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07400/0x2afbce82f55a5776 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a577d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211820.267637:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211820.267639:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211820.267642:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211820.267768:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3307:x1875075660862336:12345-0@lo:9:umount.0 Request processed in 375us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211820.267776:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:1.0:1788211820.267867:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211820.267969:0:12590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe07f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3307:x1875075660862208:12345-0@lo:9:umount.0 Request processed in 1074us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211820.267977:0:12590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788211820.268088:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660862464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788211820.268127:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788211820.268304:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfd86dd000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788211820.268325:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788211820.268328:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788211820.268332:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660862208:0@lo:9:umount.0 00000100:00080000:0.0:1788211820.268348:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec5af8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788211820.268373:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660862464 00000004:00080000:0.0:1788211820.268376:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788211820.268379:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788211820.268380:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660862464 00000100:00100000:0.0:1788211820.268384:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660862336:0@lo:9:umount.0 00000100:00100000:1.0:1788211820.268424:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788211820.268433:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+15:3309:x1875075660862464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788211820.268449:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211820.268479:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6063200/0x2afbce82f55a577d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a5776 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211820.268498:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211820.268558:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afe7852e-b478-4e21-8864-7e739fb0a137+14:3309:x1875075660862464:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211820.268568:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788211820.268622:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660862464:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788211820.273738:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8abfc540cd28) has no exports 00000020:00000080:3.0:1788211820.335792:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a5291 00000020:00000080:3.0:1788211820.335819:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abff600f000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788211820.335859:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788211820.335948:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788211820.335962:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788211820.335968:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8abfd2a98000) has no exports 00000020:00000080:2.0:1788211820.336125:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abff600f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788211820.336413:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a528a 00000020:00000080:3.0:1788211820.336420:0:13032:0:(genops.c:885:class_export_put()) final put ffff8ac001fd6000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788211820.336531:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ac001fd6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788211820.336670:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788211820.336683:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788211820.336690:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abffdb8a800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788211820.336695:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8abffdb8a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788211820.336708:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1788211820.710653:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788211820.895268:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000020:00000080:1.0:1788211820.895280:0:7655:0:(genops.c:885:class_export_put()) final put ffff8abffe3d5000/a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000001:00100000:1.0:1788211820.895328:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788211820.895332:0:7655:0:(genops.c:885:class_export_put()) final put ffff8abfcaf35800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788211820.895356:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abffe3d5000/a688ef06-7eb0-4c47-9425-de9843f5c0e0 for lustre-OST0001 00000020:00000080:1.0:1788211820.895436:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfcaf35800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788211820.895488:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abffe3d4800 for lustre-OST0001 00000020:00000080:1.0:1788211820.895496:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfcaf31800 for lustre-OST0001 00000001:00100000:2.0:1788211820.904558:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cd57119c-37bb-4375-96c6-4462114b4b2c 00000001:00080000:2.0:1788211820.904589:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1788211820.904596:0:5865:0:(genops.c:885:class_export_put()) final put ffff8abfca9e4000/cd57119c-37bb-4375-96c6-4462114b4b2c 00000001:00080000:2.0:1788211820.904640:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:2.0:1788211820.904671:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000001:00080000:2.0:1788211820.904681:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788211820.904688:0:5865:0:(genops.c:885:class_export_put()) final put ffff8abec67d2800/a688ef06-7eb0-4c47-9425-de9843f5c0e0 00000020:00000080:3.0:1788211820.907675:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfca9e4000/cd57119c-37bb-4375-96c6-4462114b4b2c for lustre-MDT0000 00000020:00000080:3.0:1788211820.907784:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec67d2800/a688ef06-7eb0-4c47-9425-de9843f5c0e0 for lustre-MDT0000 00000020:00000080:3.0:1788211820.907842:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfca9e6000 for lustre-MDT0000 00000020:00000080:3.0:1788211820.907852:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec67d4000 for lustre-MDT0000 00010000:00010000:0.0:1788211821.734648:0:13034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788211822.373453:0:13032:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfd0b67060 - data ffff8abfee606798/ffff8abfef919800 00000020:01000000:3.0:1788211822.373619:0:13032:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfe4b838a0 - data ffff8abff18430d8/ffff8abfc8123c00 00000001:00000004:3.0:1788211822.383308:0:13032:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1788211822.508954:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788211822.508963:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788211822.508984:0:13032:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788211822.508987:0:13032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788211822.510249:0:6801:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788211822.510256:0:6801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788211822.510267:0:6801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788211822.511139:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788211822.511145:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788211822.511157:0:13032:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788211822.511160:0:13032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788211822.512612:0:7939:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788211822.512626:0:7939:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788211822.512638:0:7939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788211822.553502:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a5259 00000020:00000080:0.0:1788211822.553522:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfd2aad800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788211822.554705:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a526e 00000020:00000080:0.0:1788211822.554718:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfefb1e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788211822.560346:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd2aad800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788211822.562004:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788211822.562022:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211822.562034:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788211822.562040:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8abfc54099b8) has no exports 00000004:01000000:0.0:1788211822.562278:0:13032:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788211822.562289:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a54ac 00000020:00000080:0.0:1788211822.562302:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abec5af9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788211822.562309:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788211822.562313:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211822.562319:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788211822.562321:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8abfd2a1b370) has no exports 00000020:00000080:0.0:1788211822.562327:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a54a5 00000020:00000080:0.0:1788211822.562331:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfd86d9800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788211822.562791:0:13032:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788211822.562797:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788211822.562803:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788211822.562810:0:13032:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788211822.562813:0:13032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788211822.562866:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211822.562874:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788211822.562883:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a53c5 00000020:00000080:0.0:1788211822.562888:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abec584f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788211822.562893:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788211822.562896:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211822.562900:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788211822.562902:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8abfd2a1cd28) has no exports 00000020:00000080:0.0:1788211822.562907:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a53be 00000020:00000080:0.0:1788211822.562910:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfd86dc800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788211822.563298:0:13032:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788211822.563302:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788211822.563304:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788211822.563309:0:13032:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788211822.563310:0:13032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788211822.563341:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211822.563346:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788211822.563374:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211822.563377:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788211822.563408:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a5275 00000020:00000080:0.0:1788211822.563414:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfefb1f800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788211822.563418:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788211822.563422:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211822.563425:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788211822.563427:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8abfc540b370) has no exports 00000020:00000080:0.0:1788211822.563446:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211822.563450:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788211822.563454:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a527c 00000020:00000080:0.0:1788211822.563457:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfefb19000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788211822.563464:0:13032:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8abfc288e800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788211822.563468:0:13032:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abfc288e800 3 00000020:01000004:0.0:1788211822.563471:0:13032:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8abfc288e800 from lustre-MDT0000 00000020:00000080:0.0:1788211822.563489:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211822.563499:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788211822.563502:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfd2b56800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788211822.563505:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd2b56800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788211822.563517:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1788211822.563723:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb1e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788211822.563730:0:8:0:(genops.c:885:class_export_put()) final put ffff8abfc6462000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788211822.563732:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc6462000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788211822.563737:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788211822.563878:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec5af9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788211822.563882:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd86d9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788211822.563890:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec5af8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788211822.563896:0:8:0:(genops.c:885:class_export_put()) final put ffff8abfd86dc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788211822.563898:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd86dc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788211822.563902:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788211822.563929:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec584f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788211822.563934:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd86dc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788211822.563938:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfd86dd000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788211822.563942:0:8:0:(genops.c:885:class_export_put()) final put ffff8abfc571e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788211822.563944:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc571e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788211822.563947:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788211822.564014:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb1f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788211822.564017:0:8:0:(genops.c:885:class_export_put()) final put ffff8abfefb1a800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788211822.564019:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb1a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788211822.564022:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788211822.564210:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb19000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1788211822.565114:0:13032:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788211822.565123:0:13032:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788211822.565130:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788211822.565138:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211822.565143:0:13032:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788211822.565150:0:13032:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8abfc9299800 afe7852e-b478-4e21-8864-7e739fb0a137 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788211822.565157:0:13032:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8abfd2a9b370) has exports, disconnecting them 00000020:00080000:0.0:1788211822.565162:0:13032:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8abfc9299800), last request at 1788211574 00000020:00000080:0.0:1788211822.565309:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a521a 00000020:00010000:0.0:1788211822.565315:0:13032:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8abfc9299800: total 0 00000100:00080000:0.0:1788211822.565320:0:13032:0:(import.c:65:import_set_state_nolock()) ffff8abfc929b000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788211822.565338:0:13032:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8abfc9299800): rc 0 00000020:00080000:0.0:1788211822.565344:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8abfd2a9b370) has no exports 00000020:00010000:1.0:1788211822.565379:0:13033:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8abfc9299800: total 0 00010000:00010000:1.0:1788211822.565419:0:13033:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8abfc9299800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788211822.565449:0:13033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a551c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a5515 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211822.565472:0:13033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6063e00/0x2afbce82f55a5538 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a5531 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211822.565483:0:13033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc0031600/0x2afbce82f55a552a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a5523 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211822.565511:0:13033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfca8cc400/0x2afbce82f55a5761 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a575a expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211822.565520:0:13033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a5546 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a553f expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211822.565531:0:13033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac0020c1200/0x2afbce82f55a5332 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a532b expref: 4 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211822.565545:0:13033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a5570 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a5569 expref: 3 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211822.565557:0:13033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb81000/0x2afbce82f55a576f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a5768 expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211822.565567:0:13033:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8abfc9299800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788211822.565580:0:13033:0:(genops.c:885:class_export_put()) final put ffff8abfc9299800/afe7852e-b478-4e21-8864-7e739fb0a137 00010000:00010000:1.0:1788211822.565676:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211822.565679:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211822.565681:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788211822.565720:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc9299800/afe7852e-b478-4e21-8864-7e739fb0a137 for MGS 00000020:00000080:2.0:1788211822.565768:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfc929b000 for MGS 00000100:00100000:2.0:1788211822.568587:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8abfc8b3aa00:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1788211822.569809:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8abfcafd6600:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1788211822.575228:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8abfc55e3800:5838] 2 exiting: rc = 0 00000100:00100000:1.0:1788211822.575513:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575524:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575532:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575539:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575545:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575552:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575559:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575566:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575574:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575596:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575602:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575607:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575614:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575620:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575626:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575632:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575640:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575646:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575653:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575659:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575666:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575672:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575678:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575685:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575691:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575696:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575701:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575707:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575713:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575719:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575725:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575731:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575738:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575745:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575750:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575756:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575762:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575767:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575773:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575778:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575783:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575788:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575794:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575799:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575814:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575820:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575825:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575830:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575836:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575842:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575847:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575851:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575857:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575863:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575869:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575875:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575880:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575886:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575891:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575896:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575902:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575907:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575913:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211822.575919:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788211822.578529:0:13032:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788211822.578538:0:13032:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788211822.593945:0:13032:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfe6f4b240 - data ffff8abffafcf870/ffff8abec7257c00 00000020:01000000:2.0:1788211822.594108:0:13032:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfc2d40000 - data ffff8abffaf89000/ffff8abfc923a800 00000020:00000080:2.0:1788211822.595899:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a51fe 00000020:00000080:2.0:1788211822.595912:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfd854b800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788211822.595927:0:13032:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8abfc288e800 from MGS, refs=2 00000020:01000004:2.0:1788211822.595930:0:13032:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abfc288e800 2 00000020:01000004:2.0:1788211822.595934:0:13032:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8abfc288e800 from MGS 00000020:00000080:2.0:1788211822.595959:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788211822.595968:0:13032:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788211822.595970:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfd854b000/MGS 00000020:00000080:2.0:1788211822.595973:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd854b000/MGS for MGS 00000020:01000000:2.0:1788211822.595981:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788211822.596043:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788211822.596047:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788211822.596052:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788211822.596060:0:13032:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8abfefb1b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788211822.596066:0:13032:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8abfd2a199b8) has exports, disconnecting them 00000020:00080000:2.0:1788211822.596071:0:13032:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8abfefb1b800), last request at 1788211575 00000020:00000080:2.0:1788211822.596076:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a52c9 00000020:00080000:2.0:1788211822.596088:0:13032:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8abfefb1b800): rc 0 00000020:00000080:2.0:1788211822.596092:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfefb1b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788211822.596900:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd854b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788211822.596917:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb1b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788211822.597352:0:13032:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788211822.597358:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788211822.597362:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788211822.597369:0:13032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788211822.597390:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfefb1d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788211822.597554:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788211822.597561:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788211822.597566:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abff6008800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788211822.597569:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8abff6008800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788211822.597574:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788211822.597667:0:13032:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abfc288e800 1 00000020:00000080:1.0:1788211822.597674:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a51f0 00000020:00000080:1.0:1788211822.597680:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfd8549800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788211822.597700:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788211822.597704:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788211822.597709:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788211822.597712:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8abfc5408000) has no exports 00000020:00000080:0.0:1788211822.597817:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd8549800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788211822.614104:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211822.614119:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788211822.614125:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfc288c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788211822.614130:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc288c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788211822.614136:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788211822.614320:0:13032:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8abfc288b800 00000020:01000000:0.0:1788211822.614344:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788211822.614348:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211822.614353:0:13032:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788211822.614357:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8abfca8bcd28) has no exports 00000100:00100000:3.0:1788211822.614475:0:6717:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8abec5aef600:6717] 3 exiting: rc = 0 00000100:00100000:0.0:1788211822.614491:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8abfd8657800:5843] 0 exiting: rc = 1 00000100:00100000:2.0:1788211822.614608:0:9952:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8abffdc87600:9952] 4 exiting: rc = 0 00000100:00100000:3.0:1788211822.614687:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8abfca89fa00:5845] 2 exiting: rc = 0 00000100:00100000:0.0:1788211822.615204:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8abfd8657600:5844] 1 exiting: rc = 0 00000100:00100000:0.0:1788211822.615350:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615357:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615363:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615369:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615373:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615379:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615385:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615390:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615395:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615401:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615406:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615412:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615417:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615422:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615429:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615434:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615440:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615445:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615451:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615456:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615462:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615468:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615473:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615478:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615727:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615734:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615740:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615745:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615750:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615756:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615762:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615767:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615773:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615778:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615784:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615798:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615805:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615811:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615818:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615824:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615829:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615838:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615844:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615849:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615855:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615861:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615868:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615874:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615880:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615886:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615892:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615898:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615904:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615911:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615917:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615923:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615929:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615940:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615946:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615952:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615959:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615964:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615970:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.615976:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.622530:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8abfca89f800:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1788211822.623482:0:12483:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8abfc2b75e00:12483] 2 exiting: rc = 0 00000100:00100000:2.0:1788211822.623564:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8abfca89f200:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1788211822.624756:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624770:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624781:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624792:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624805:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624833:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624845:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624857:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624869:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624881:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624892:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624904:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624916:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624928:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624940:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624951:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624962:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624972:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624983:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.624993:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625004:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625016:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625028:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625039:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625050:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625059:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625070:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625080:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625090:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625101:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625112:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625123:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625133:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625143:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625153:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625163:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625201:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625212:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625224:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625234:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625254:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625265:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625276:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625287:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625299:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625308:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625314:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625319:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625324:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625330:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625337:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625343:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625348:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625354:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625359:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625364:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625369:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625374:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625379:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625385:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625392:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625399:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625405:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.625412:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211822.629629:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8abfc9293200:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1788211822.630282:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8abfc8c6ac00:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1788211822.630823:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630832:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630839:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630844:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630850:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630856:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630863:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630870:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630877:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630884:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630906:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630927:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630934:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630941:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630951:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630957:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630963:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630970:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630981:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630987:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.630994:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631000:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631022:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631029:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631035:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631042:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631049:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631055:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631062:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631070:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631077:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631083:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631090:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631096:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631115:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631123:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631129:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631135:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631142:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631148:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631154:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631160:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631311:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631320:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631328:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631337:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631383:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631395:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631401:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631411:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631420:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631751:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631758:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631764:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631771:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631777:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631783:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.631790:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.636034:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.636054:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.636064:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.636071:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.636078:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.636084:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211822.655211:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8abfc8c6ba00:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1788211822.655756:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8abfc8c6a200:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1788211822.656664:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656672:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656677:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656683:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656688:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656693:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656699:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656705:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656710:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656715:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656720:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656726:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656732:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656737:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656743:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656748:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656755:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656760:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656766:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656771:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656776:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656781:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656787:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656793:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656799:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656804:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656809:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656814:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656832:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656837:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656843:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656848:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656853:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656859:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656864:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656870:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656875:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656879:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656884:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656888:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656893:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656898:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656903:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656907:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656912:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656916:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656921:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656925:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656930:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656934:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656938:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656943:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656948:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656952:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656957:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656962:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656966:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656971:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656976:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656981:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656987:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656992:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.656998:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.657009:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.657428:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8abfd2b6d600:5853] 1 exiting: rc = 0 00000100:00100000:1.0:1788211822.657805:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8abfca8e7e00:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1788211822.657982:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.657988:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.657994:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658000:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658005:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658011:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658017:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658022:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658028:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658033:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658038:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658043:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658049:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658054:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658060:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658065:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658071:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658076:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658081:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658087:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658092:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658097:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658103:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658108:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658114:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658119:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658125:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658130:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658135:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658141:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658147:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658152:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658158:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658250:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658257:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658262:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658267:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658272:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658278:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658283:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658288:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658294:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658299:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658304:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658310:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658315:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658320:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658325:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658331:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658337:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658343:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658348:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658354:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658359:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658365:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658370:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658374:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658379:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658384:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658388:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658393:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658398:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658402:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.658407:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659069:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8abfc8c45a00:5855] 1 exiting: rc = 0 00000100:00100000:3.0:1788211822.659361:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8abfd2b69200:5854] 0 exiting: rc = 1 00000100:00100000:3.0:1788211822.659426:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659432:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659448:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659453:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659458:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659464:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659469:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659474:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659481:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659486:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659490:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659495:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659500:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659505:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659509:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659513:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659518:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659522:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659527:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659532:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659537:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659542:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659547:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659552:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659556:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659560:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659567:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659573:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659695:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659703:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659709:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659715:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659720:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659726:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659731:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659737:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659742:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659757:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659763:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659769:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659774:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659779:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659785:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659791:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659797:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659802:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659808:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659813:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659818:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659822:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659827:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659832:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659838:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659843:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659848:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659852:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659858:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659863:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659868:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659873:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659879:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659884:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659889:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.659893:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.660983:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8abfc8c6b800:5856] 0 exiting: rc = 1 00000100:00100000:3.0:1788211822.661303:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8abfc8c6b200:5857] 1 exiting: rc = 0 00000100:00100000:3.0:1788211822.661516:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8abfc8c6a000:5858] 2 exiting: rc = 0 00000100:00100000:3.0:1788211822.661600:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661607:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661613:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661619:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661624:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661643:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661649:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661654:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661660:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661666:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661684:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661692:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661697:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661703:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661709:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661715:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661720:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661726:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661732:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661737:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661743:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661749:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661754:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661758:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661764:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661769:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661774:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661784:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661789:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661798:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661803:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661811:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661817:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661826:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661849:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661863:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661873:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661881:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661896:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661912:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661925:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661939:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661945:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661954:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661960:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661971:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661977:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661982:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661988:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.661994:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662000:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662006:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662012:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662018:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662023:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662029:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662034:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662040:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662046:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662052:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662057:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662063:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662069:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211822.662085:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788211822.669151:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788211822.675564:0:13032:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788211822.675626:0:13032:0:(genops.c:885:class_export_put()) final put ffff8abfd2aab000/MDS_uuid 00000020:00000080:3.0:1788211822.675633:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd2aab000/MDS_uuid for MDS 00000020:01000000:3.0:1788211822.675644:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788211822.679107:0:13032:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788211822.763881:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211822.822855:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660862720:0@lo:400:kworker.0 00000400:00000100:2.0:1788211822.822923:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875075660862720 offset 0 length 224: 4 00000100:00100000:2.0:1788211822.822986:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788211822.822993:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660862592:0@lo:400:kworker.0 00000400:00000100:2.0:1788211822.823012:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875075660862592 offset 0 length 224: 4 00000100:00100000:2.0:1788211822.823036:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788211822.823043:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660862848:0@lo:400:kworker.0 00000400:00000100:2.0:1788211822.823061:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875075660862848 offset 0 length 224: 4 00010000:00010000:2.0:1788211823.783657:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788211823.911001:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788211823.911010:0:6720:0:(genops.c:885:class_export_put()) final put ffff8abec5adf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788211823.911306:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec5adf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788211823.911363:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec5ade800 for lustre-OST0000 00010000:00010000:2.0:1788211824.805355:0:13034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788211825.577828:0:13192:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788211825.587550:0:13192:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788211825.588290:0:13192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211825.588306:0:13192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211825.588315:0:13192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211825.588322:0:13192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211825.588345:0:13192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788211825.588352:0:13192:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788211825.588382:0:13192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788211825.588396:0:13192:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8abfef634000 x1875075660862720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211838 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211825.588414:0:13192:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788211825.588421:0:13192:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788211825.588449:0:13192:0:(import.c:65:import_set_state_nolock()) ffff8abec5afd800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788211825.588493:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875075660862976:0@lo:39:umount.0 00000100:00100000:3.0:1788211825.588556:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660862720:0@lo:400:kworker.0 00000400:00000100:0.0:1788211825.588558:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875075660862976 offset 0 length 224: 4 00010000:00010000:1.0:1788211825.588711:0:13033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788211825.588721:0:13033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211825.588730:0:13033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06000 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788211825.588734:0:13033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211825.588745:0:13033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788211825.588754:0:13033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211825.588761:0:13033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788211825.588764:0:13033:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788211825.588767:0:13033:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788211825.588811:0:13033:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211825.588819:0:13033:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788211825.588869:0:13033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211825.588878:0:13033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06000/0x2afbce82f55a5531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a5538 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211825.588894:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211825.588896:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211825.588899:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211825.589338:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660863104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211825.589386:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211825.589513:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660863104 00000100:00100000:1.0:1788211825.589521:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660863104 00000100:00100000:1.0:1788211825.589571:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788211825.589581:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3309:x1875075660863104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788211825.589588:0:5828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788211825 with bad export cookie 3097296230604755482 00000100:00100000:0.0:1788211825.609031:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3309:x1875075660863104:12345-0@lo:103:ldlm_bl.0 Request processed in 19437us (19631us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788211825.609049:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788211825.609995:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788211825.610001:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8abfe4b5a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788211825.610005:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788211825.623040:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.129@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788211825.623046:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788211825.623054:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8abfef635880 x1875075660862592/t0(0) o400->MGC192.168.204.129@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788211838 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211825.623074:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac001364380 x1875075660863104/t0(0) o103->MGC192.168.204.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788211841 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788211825.623084:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788211825.623086:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788211825.623088:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788211825.623091:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8abfe4b5a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788211825.623095:0:3309:0:(import.c:510:import_select_connection()) MGC192.168.204.129@tcp: connect to NID 0@lo last attempt 164 00000100:00080000:1.0:1788211825.623104:0:3309:0:(import.c:624:import_select_connection()) MGC192.168.204.129@tcp: import ffff8abfe4b5a800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1788211825.623802:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afe7852e-b478-4e21-8864-7e739fb0a137:3311:1875075660862592:0@lo:400:kworker.0 00000100:00100000:2.0:1788211825.624947:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfef637480 x1875075660863232/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788211825.625013:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afe7852e-b478-4e21-8864-7e739fb0a137:3309:1875075660863104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788211825.628490:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:afe7852e-b478-4e21-8864-7e739fb0a137:3307:1875075660863232:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1788211825.629302:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875075660863232 offset 0 length 520: 4 00010000:00010000:0.0:1788211825.830046:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211826.853832:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211827.877699:0:13034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788211827.941346:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) afe7852e-b478-4e21-8864-7e739fb0a137->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788211827.941367:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) afe7852e-b478-4e21-8864-7e739fb0a137->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788211827.941545:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660863360:0@lo:400:kworker.0 00000400:00000100:2.0:1788211827.941614:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875075660863360 offset 0 length 224: 4 00010000:00010000:1.0:1788211828.901715:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211829.926239:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788211829.989616:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) afe7852e-b478-4e21-8864-7e739fb0a137->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788211829.989627:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) afe7852e-b478-4e21-8864-7e739fb0a137->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788211829.989757:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788211829.989778:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660863488:0@lo:400:kworker.0 00000400:00000100:2.0:1788211829.989834:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875075660863488 offset 0 length 224: 4 00010000:00010000:0.0:1788211830.949416:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211831.975474:0:13034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211833.000525:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211834.024920:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211835.047277:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211835.112304:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788211825/real 1788211825] req@ffff8abfef637480 x1875075660863232/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788211835 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211835.112354:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8abfef637480 x1875075660863232/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788211835 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211835.112365:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788211825/real 1788211825] req@ffff8abfca878e00 x1875075660862976/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788211835 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211835.112377:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8abfca878e00 x1875075660862976/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788211835 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788211835.112393:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfe4b5a800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788211835.112402:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788211835.112406:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:afe7852e-b478-4e21-8864-7e739fb0a137:3307:1875075660863232:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1788211835.112412:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec5afd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788211835.112677:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875075660862976:0@lo:39:umount.0 00000100:00080000:0.0:1788211835.112752:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) afe7852e-b478-4e21-8864-7e739fb0a137->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788211835.112757:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788211835.112760:0:8:0:(import.c:65:import_set_state_nolock()) ffff8abfe4b5a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788211835.112765:0:8:0:(import.c:510:import_select_connection()) MGC192.168.204.129@tcp: connect to NID 0@lo last attempt 414 00000100:00080000:0.0:1788211835.112770:0:8:0:(import.c:589:import_select_connection()) MGC192.168.204.129@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788211835.112777:0:8:0:(import.c:624:import_select_connection()) MGC192.168.204.129@tcp: import ffff8abfe4b5a800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1788211835.112810:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfca879f80 x1875075660863616/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788211835.112880:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788211835.112893:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660863744:0@lo:400:kworker.0 00000400:00000100:0.0:1788211835.112953:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875075660863744 offset 0 length 224: 4 00000100:00100000:3.0:1788211835.116997:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:afe7852e-b478-4e21-8864-7e739fb0a137:3307:1875075660863616:0@lo:250:kworker.0 00000400:00000100:3.0:1788211835.117070:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875075660863616 offset 0 length 520: 4 00000100:00080000:2.0:1788211835.124694:0:13192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788211835.124706:0:13192:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788211835.124716:0:13192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788211835.125656:0:13192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211835.125673:0:13192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211835.125680:0:13192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211835.125686:0:13192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211835.125714:0:13192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211835.125722:0:13192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211835.125749:0:13192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211835.125754:0:13192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211835.125760:0:13192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211835.125779:0:13192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788211835.125785:0:13192:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788211835.125807:0:13192:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788211835.125812:0:13192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788211835.125817:0:13192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788211835.125823:0:13192:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788211835.125828:0:13192:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8abfca8a3370) has no exports 00000020:00080000:2.0:1788211835.125856:0:13192:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8abfca8a3370) has no exports 00010000:00010000:1.0:1788211835.125901:0:13033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788211835.125908:0:13033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211835.125917:0:13033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030e00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788211835.125931:0:13033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211835.125941:0:13033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788211835.125949:0:13033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211835.125956:0:13033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788211835.125958:0:13033:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788211835.125960:0:13033:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788211835.125981:0:13033:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8abfe4b5a800 00010000:00010000:1.0:1788211835.125985:0:13033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211835.125993:0:13033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc0030e00/0x2afbce82f55a553f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a5546 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211835.126011:0:13033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788211835.126014:0:13033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211835.126027:0:13033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06200 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788211835.126030:0:13033:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211835.126037:0:13033:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788211835.126043:0:13033:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211835.126048:0:13033:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788211835.126050:0:13033:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788211835.126051:0:13033:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788211835.126056:0:13033:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8abfe4b5a800 00010000:00010000:1.0:1788211835.126059:0:13033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211835.126065:0:13033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a5768 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a576f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211835.126074:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211835.126076:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211835.126078:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211835.130579:0:13034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788211835.138587:0:13192:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abff7038240 - data ffff8abff1a96e58/ffff8abec6233800 00000020:01000000:2.0:1788211835.138722:0:13192:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfd87fa9c0 - data ffff8abff1adf798/ffff8abec6065c00 00100000:10000000:2.0:1788211835.152989:0:13192:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788211835.256660:0:13192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a534e 00000020:00000080:0.0:1788211835.256670:0:13192:0:(genops.c:885:class_export_put()) final put ffff8abec5879000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788211835.256692:0:13192:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac001fd6800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788211835.256696:0:13192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ac001fd6800 2 00000020:01000004:0.0:1788211835.256700:0:13192:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ac001fd6800 from lustre-OST0000 00000020:00000080:0.0:1788211835.256725:0:13192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211835.256734:0:13192:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788211835.256737:0:13192:0:(genops.c:885:class_export_put()) final put ffff8abec587c000/lustre-OST0000_UUID 00000020:00000080:0.0:1788211835.256740:0:13192:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec587c000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788211835.256748:0:13192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788211835.256789:0:13192:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788211835.256793:0:13192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788211835.256809:0:13192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211835.256814:0:13192:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788211835.256821:0:13192:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8abec5ad9000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788211835.256827:0:13192:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8abfca8a0000) has exports, disconnecting them 00000020:00080000:0.0:1788211835.256832:0:13192:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8abec5ad9000), last request at 1788211594 00000020:00000080:0.0:1788211835.256836:0:13192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a5378 00000020:00080000:0.0:1788211835.256846:0:13192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8abec5ad9000): rc 0 00000020:00000080:0.0:1788211835.256851:0:13192:0:(genops.c:885:class_export_put()) final put ffff8abec5ad9000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788211835.257315:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec5879000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788211835.257327:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec5ad9000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788211835.258010:0:13192:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788211835.258016:0:13192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788211835.258021:0:13192:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788211835.258030:0:13192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788211835.258693:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec5afd800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788211835.258737:0:13192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788211835.258744:0:13192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788211835.258757:0:13192:0:(genops.c:885:class_export_put()) final put ffff8abec587a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788211835.258760:0:13192:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec587a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788211835.258770:0:13192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788211835.258816:0:13192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ac001fd6800 1 00000020:00000080:1.0:1788211835.258822:0:13192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a5308 00000020:00000080:1.0:1788211835.258828:0:13192:0:(genops.c:885:class_export_put()) final put ffff8abfc571e000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788211835.258843:0:13192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788211835.258847:0:13192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788211835.258851:0:13192:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788211835.258854:0:13192:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8abfd2a999b8) has no exports 00000020:00000080:3.0:1788211835.259455:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc571e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788211835.304253:0:13192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788211835.304272:0:13192:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788211835.304278:0:13192:0:(genops.c:885:class_export_put()) final put ffff8abfc571d000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788211835.304283:0:13192:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc571d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788211835.304294:0:13192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788211835.304453:0:13192:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8abfc571a800 00000020:02000400:3.0:1788211835.304496:0:13192:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788211836.069508:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211837.094359:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211838.120271:0:13033:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788211838.181699:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788211822/real 1788211822] req@ffff8abfef636d80 x1875075660862848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788211838 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211838.232570:0:3309:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8abfef636d80 x1875075660862848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788211838 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788211838.232588:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8abec6692000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788211838.232592:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788211838.248536:0:3309:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1788211838.250244:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660862848:0@lo:400:kworker.0 00000100:00080000:2.0:1788211838.252160:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) afe7852e-b478-4e21-8864-7e739fb0a137->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788211838.253137:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) afe7852e-b478-4e21-8864-7e739fb0a137->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788211838.253140:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788211838.253144:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788211838.253149:0:36:0:(import.c:65:import_set_state_nolock()) ffff8abec6692000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788211838.253161:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 205 00000100:00080000:2.0:1788211838.253213:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8abec6692000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1788211838.253253:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfef636a00 x1875075660863872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788211838.255424:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875075660863872:0@lo:38:kworker.0 00000400:00000100:1.0:1788211838.255511:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875075660863872 offset 0 length 520: 4 00000020:01000004:0.0:1788211838.972956:0:13344:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788211838.995882:0:13344:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788211838.995987:0:13344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211838.996003:0:13344:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211838.996009:0:13344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211838.996016:0:13344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211838.996053:0:13344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788211838.996060:0:13344:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788211838.996095:0:13344:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788211838.996108:0:13344:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac001201500 x1875075660863360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211843 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211838.996133:0:13344:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac001202680 x1875075660863488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211845 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211838.996143:0:13344:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8abfca879500 x1875075660863744/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211851 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211838.996158:0:13344:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8abfef636a00 x1875075660863872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788211848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211838.996187:0:13344:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788211838.996195:0:13344:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788211838.996212:0:13344:0:(import.c:65:import_set_state_nolock()) ffff8abec6692000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788211838.996218:0:13344:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788211838.996222:0:13344:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac001201500 x1875075660863360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211843 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211838.996231:0:13344:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac001202680 x1875075660863488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211845 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211838.996239:0:13344:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8abfca879500 x1875075660863744/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211851 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211838.996246:0:13344:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8abfef636a00 x1875075660863872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788211848 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211838.996252:0:13344:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788211838.996255:0:13344:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1788211838.996351:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660863488:0@lo:400:kworker.0 00000100:00100000:2.0:1788211838.996379:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660863360:0@lo:400:kworker.0 00000100:00100000:1.0:1788211838.996580:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660863744:0@lo:400:kworker.0 00000100:00100000:1.0:1788211838.996626:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875075660863872:0@lo:38:kworker.0 00010000:00010000:3.0:1788211838.996771:0:13034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211838.996779:0:13034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211838.996792:0:13034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06c00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211838.996795:0:13034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211838.996804:0:13034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211838.996812:0:13034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211838.996818:0:13034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788211838.996821:0:13034:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788211838.996823:0:13034:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788211838.996855:0:13034:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8abfe4b5a800 00010000:00010000:3.0:1788211838.996860:0:13034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211838.996881:0:13034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06c00/0x2afbce82f55a5515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a551c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211838.996894:0:13034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211838.996895:0:13034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211838.996897:0:13034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211838.998606:0:13344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211838.998627:0:13344:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211838.998634:0:13344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211838.998640:0:13344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211838.998663:0:13344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788211838.998671:0:13344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211838.998679:0:13344:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211838.998686:0:13344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211838.998692:0:13344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211838.998700:0:13344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788211838.998705:0:13344:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788211838.998737:0:13344:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:2.0:1788211838.999041:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788211838.999050:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211838.999058:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80c00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:2.0:1788211838.999062:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211838.999072:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211838.999079:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211838.999086:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788211838.999088:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788211838.999091:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788211838.999104:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8abfe4b5a800 00010000:00010000:2.0:1788211838.999108:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211838.999115:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abffdb80c00/0x2afbce82f55a5523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a552a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211838.999148:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211838.999152:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211838.999159:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81c00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:2.0:1788211838.999162:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211838.999195:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211838.999216:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211838.999221:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788211838.999223:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788211838.999225:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788211838.999230:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8abfe4b5a800 00010000:00010000:2.0:1788211838.999233:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211838.999239:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a575a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a5761 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211838.999252:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211838.999254:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211838.999256:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788211838.999646:0:13344:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788211838.999653:0:13344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211838.999662:0:13344:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788211838.999675:0:13344:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8abfca8bb370) has no exports 00000020:00080000:0.0:1788211838.999712:0:13344:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8abfca8bb370) has no exports 00010000:00010000:1.0:1788211839.000081:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788211839.011799:0:13344:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfe6f4b600 - data ffff8abffafcf948/ffff8abec7257000 00000020:01000000:1.0:1788211839.012295:0:13344:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfd0510720 - data ffff8abfd8b8b288/ffff8abfef906000 00100000:10000000:2.0:1788211839.031126:0:13344:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788211839.061659:0:13344:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a5419 00000020:00000080:3.0:1788211839.061670:0:13344:0:(genops.c:885:class_export_put()) final put ffff8abfff89b000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788211839.061689:0:13344:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8abfcaf32000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788211839.061693:0:13344:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abfcaf32000 2 00000020:01000004:3.0:1788211839.061697:0:13344:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8abfcaf32000 from lustre-OST0001 00000020:00000080:3.0:1788211839.061740:0:13344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788211839.061751:0:13344:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788211839.061754:0:13344:0:(genops.c:885:class_export_put()) final put ffff8ac001fd0800/lustre-OST0001_UUID 00000020:00000080:3.0:1788211839.061757:0:13344:0:(genops.c:844:class_export_destroy()) destroying export ffff8ac001fd0800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788211839.061764:0:13344:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1788211839.061871:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfff89b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1788211839.061902:0:13344:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import afe7852e-b478-4e21-8864-7e739fb0a137->MGS 00010000:00010000:3.0:1788211839.061917:0:13344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfcb37a600/0x2afbce82f55a532b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a5332 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211839.061930:0:13344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37a600/0x2afbce82f55a532b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a5332 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211839.061946:0:13344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788211839.061949:0:13344:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788211839.061952:0:13344:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788211839.061968:0:13344:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8abfe4b5a800 00010000:00010000:3.0:1788211839.061972:0:13344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfcb37a600/0x2afbce82f55a532b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a5332 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211839.061997:0:13344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07e00/0x2afbce82f55a5569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a5570 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211839.062003:0:13344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07e00/0x2afbce82f55a5569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a5570 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211839.062009:0:13344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788211839.062011:0:13344:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788211839.062013:0:13344:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788211839.062024:0:13344:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8abfe4b5a800 00010000:00010000:3.0:1788211839.062027:0:13344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07e00/0x2afbce82f55a5569 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a5570 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788211839.062045:0:13344:0:(import.c:65:import_set_state_nolock()) ffff8abfe4b5a800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788211839.062048:0:13344:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788211839.062051:0:13344:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788211839.062052:0:13344:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788211839.062056:0:13344:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788211839.062066:0:13344:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8abfca879f80 x1875075660863616/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788211850 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788211839.062087:0:13344:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788211839.062090:0:13344:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:1.0:1788211839.062311:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:afe7852e-b478-4e21-8864-7e739fb0a137:3307:1875075660863616:0@lo:250:kworker.0 10000000:01000000:3.0:1788211839.062468:0:13344:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788211839.062476:0:13344:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a520c 00000020:00000080:3.0:1788211839.062480:0:13344:0:(genops.c:885:class_export_put()) final put ffff8abfd2aa9800/afe7852e-b478-4e21-8864-7e739fb0a137 00000020:01000000:3.0:1788211839.062494:0:13344:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.129@tcp (flags='') 00000020:00000080:3.0:1788211839.062499:0:13344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788211839.062504:0:13344:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788211839.062508:0:13344:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8abfca8a4d28) has no exports 00000020:00000080:2.0:1788211839.062556:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd2aa9800/afe7852e-b478-4e21-8864-7e739fb0a137 for MGC192.168.204.129@tcp 10000000:01000000:1.0:1788211839.062736:0:5840:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788211839.062812:0:13344:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.129@tcp: client import never connected 00000100:00080000:3.0:1788211839.062823:0:13344:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788211839.062825:0:13344:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788211839.062827:0:13344:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788211839.062829:0:13344:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788211839.062876:0:13344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788211839.062882:0:13344:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.129@tcp (uuid afe7852e-b478-4e21-8864-7e739fb0a137) 00000020:01000000:3.0:1788211839.062887:0:13344:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788211839.062890:0:13344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788211839.062893:0:13344:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788211839.062898:0:13344:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8abec67d3000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788211839.062903:0:13344:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8abfca8a19b8) has exports, disconnecting them 00000020:00080000:3.0:1788211839.062908:0:13344:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8abec67d3000), last request at 1788211615 00000020:00000080:3.0:1788211839.062912:0:13344:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a5443 00000020:00080000:3.0:1788211839.062924:0:13344:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8abec67d3000): rc 0 00000020:00000080:3.0:1788211839.062927:0:13344:0:(genops.c:885:class_export_put()) final put ffff8abec67d3000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788211839.063715:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfe4b5a800 for MGC192.168.204.129@tcp 00000020:00000080:2.0:1788211839.063726:0:36:0:(genops.c:885:class_export_put()) final put ffff8abfe4b5d000/afe7852e-b478-4e21-8864-7e739fb0a137 00000020:00000080:2.0:1788211839.063729:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfe4b5d000/afe7852e-b478-4e21-8864-7e739fb0a137 for MGC192.168.204.129@tcp 00000020:01000000:2.0:1788211839.063738:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.129@tcp (afe7852e-b478-4e21-8864-7e739fb0a137) 00000020:00000080:2.0:1788211839.064019:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec67d3000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788211839.065950:0:13344:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788211839.065958:0:13344:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788211839.065963:0:13344:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788211839.065970:0:13344:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788211839.066051:0:13033:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788211839.066200:0:13034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788211839.066266:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000020:00000080:1.0:1788211839.066414:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec6692000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788211839.066429:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1788211839.066919:0:8518:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8abfc2a30000:8518] 2 exiting: rc = 0 00000100:00100000:1.0:1788211839.067961:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8abfd8656800:5826] 0 exiting: rc = 1 00000100:00100000:1.0:1788211839.068621:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8abfd8656c00:5827] 1 exiting: rc = 0 00000100:00100000:2.0:1788211839.069132:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.070028:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8abfd0b62200:5830] 2 exiting: rc = 0 00000100:00100000:1.0:1788211839.070131:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8abfe4b8b400:5829] 1 exiting: rc = 0 00000100:00100000:2.0:1788211839.070804:0:13035:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8abec5aee000:13035] 3 exiting: rc = 0 00000100:00100000:1.0:1788211839.075796:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8abfe4b8c200:5828] 0 exiting: rc = 1 00000100:00100000:2.0:1788211839.076052:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076065:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076073:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076079:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076085:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076091:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076096:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076104:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076110:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076116:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076122:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076128:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076133:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076139:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076145:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076208:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076215:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076221:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076226:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076232:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076237:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076243:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076248:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076253:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076258:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076263:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076268:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076274:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076280:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076285:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076290:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076295:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076299:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076303:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076308:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076313:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076318:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076322:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076327:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076333:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076337:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076342:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076347:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076352:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076356:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076361:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076367:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076373:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076378:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076383:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076397:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076402:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076407:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076413:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076418:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076423:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076429:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076434:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076439:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076444:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076449:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076454:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076459:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.076465:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788211839.085069:0:13344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788211839.085088:0:13344:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788211839.085096:0:13344:0:(genops.c:885:class_export_put()) final put ffff8abec5ad9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788211839.085102:0:13344:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec5ad9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788211839.085109:0:13344:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788211839.085381:0:13344:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abfcaf32000 1 00000020:00000080:1.0:1788211839.085389:0:13344:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a53e8 00000020:00000080:1.0:1788211839.085398:0:13344:0:(genops.c:885:class_export_put()) final put ffff8abfcaf36000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788211839.085451:0:13344:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788211839.085458:0:13344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788211839.085463:0:13344:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788211839.085467:0:13344:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8abff7024d28) has no exports 00000020:00000080:2.0:1788211839.090026:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfcaf36000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788211839.115875:0:13344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788211839.115891:0:13344:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788211839.115897:0:13344:0:(genops.c:885:class_export_put()) final put ffff8abfcaf34000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788211839.115902:0:13344:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfcaf34000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788211839.115914:0:13344:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788211839.116254:0:13344:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8abfcaf37000 00000020:01000000:1.0:1788211839.116277:0:13344:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788211839.116282:0:13344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788211839.116286:0:13344:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788211839.116291:0:13344:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8abfd2a9cd28) has no exports 00000020:00000080:1.0:1788211839.116321:0:13344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788211839.116328:0:13344:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788211839.116331:0:13344:0:(genops.c:885:class_export_put()) final put ffff8abfc571c800/OSS_uuid 00000020:00000080:1.0:1788211839.116333:0:13344:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc571c800/OSS_uuid for OSS 00000020:01000000:1.0:1788211839.116337:0:13344:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788211839.116361:0:5839:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788211839.116839:0:8290:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8abfefb05400:8290] 3 exiting: rc = 0 00000100:00100000:3.0:1788211839.116856:0:12590:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8abec6119e00:12590] 4 exiting: rc = 0 00000100:00100000:0.0:1788211839.116956:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8abfd86cd000:6696] 2 exiting: rc = 0 00000100:00100000:3.0:1788211839.116995:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8abffdb82800:6695] 1 exiting: rc = 0 00000100:00100000:1.0:1788211839.117261:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8abffe2df800:6693] 0 exiting: rc = 1 00000100:00100000:1.0:1788211839.117342:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117361:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117379:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117387:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117392:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117397:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117401:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117407:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117412:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117417:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117422:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117428:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117433:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117438:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117443:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117448:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117453:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117459:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117464:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117469:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117474:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117479:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117484:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117489:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117495:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117500:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117515:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117521:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117526:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117532:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117536:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117541:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117546:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117551:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117556:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117561:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117571:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117577:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117582:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117586:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117591:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117597:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117602:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117607:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117612:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117617:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117621:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117626:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117631:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117636:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117641:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117646:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117651:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117656:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117661:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117666:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117670:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117676:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117683:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117689:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117694:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117700:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117704:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.117710:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.118468:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8abfe4b8b200:6698] 1 exiting: rc = 0 00000100:00100000:1.0:1788211839.118535:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8abffdb82600:6697] 0 exiting: rc = 1 00000100:00100000:2.0:1788211839.125996:0:8635:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8ac001254800:8635] 2 exiting: rc = 0 00000100:00100000:1.0:1788211839.126632:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126643:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126649:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126655:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126660:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126693:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126700:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126705:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126710:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126715:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126720:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126725:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126730:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126735:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126740:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126745:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126751:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126758:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126762:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126767:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126772:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126777:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126781:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126793:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126799:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126804:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126811:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126816:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126822:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126826:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126831:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126836:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126859:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126864:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126870:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126875:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126879:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126885:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126890:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126895:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126909:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126914:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126919:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126923:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126928:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126934:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126939:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126943:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126949:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126956:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126961:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126966:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126971:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126976:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126981:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126986:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126992:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.126998:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.127003:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.127008:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.127013:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.127019:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.127024:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.127030:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.129274:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8abffdb82c00:6699] 0 exiting: rc = 1 00000100:00100000:2.0:1788211839.129484:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8abfcd897e00:6701] 2 exiting: rc = 0 00000100:00100000:1.0:1788211839.129930:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8abfcd896200:6700] 1 exiting: rc = 0 00000100:00100000:1.0:1788211839.130009:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130016:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130022:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130028:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130034:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130041:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130047:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130052:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130058:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130064:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130083:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130089:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130096:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130112:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130121:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130127:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130132:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130138:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130143:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130149:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130155:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130162:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130188:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130199:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130205:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130211:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130217:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130226:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130231:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130237:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130243:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130250:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130257:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130272:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130279:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130283:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130290:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130308:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130315:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130320:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130326:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130331:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130337:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130343:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130348:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130362:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130367:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130372:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130378:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130383:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130388:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130394:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130399:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130405:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130411:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130417:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130423:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130440:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130447:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130453:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130461:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.130467:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.132042:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.132056:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211839.143014:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8abfc8b70000:6702] 0 exiting: rc = 1 00000100:00100000:1.0:1788211839.143112:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8abff6434000:6703] 1 exiting: rc = 0 00000100:00100000:2.0:1788211839.143231:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143240:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143246:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143252:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143257:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143263:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143269:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143275:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143281:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143287:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143292:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143297:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143301:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143307:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143312:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143317:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143340:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143346:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143352:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143357:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143362:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143367:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143373:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143379:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143384:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143389:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143394:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143399:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143404:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143408:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143413:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143418:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143424:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143429:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143435:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143440:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143445:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143450:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143455:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143461:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143467:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143472:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143477:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143482:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143488:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143493:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143498:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143503:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143508:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143513:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143517:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143530:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143535:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143541:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143546:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143551:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143556:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143561:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143566:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143571:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143577:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143582:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143588:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.143601:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144327:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8abec113f000:6705] 1 exiting: rc = 0 00000100:00100000:1.0:1788211839.144328:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8abec113ee00:6704] 0 exiting: rc = 1 00000100:00100000:2.0:1788211839.144416:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144424:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144430:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144436:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144444:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144448:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144453:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144458:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144463:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144467:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144477:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144498:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144506:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144513:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144520:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144527:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144534:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144542:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144547:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144553:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144560:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144574:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144580:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144612:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144623:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144631:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144639:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144648:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144655:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144667:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144682:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144690:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144695:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144700:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144706:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144726:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144734:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144740:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144746:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144752:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144758:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144763:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144771:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144779:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144798:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144818:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144826:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144832:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144838:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144857:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144892:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144913:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144920:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144926:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144931:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144936:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144950:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144955:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144961:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144966:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144972:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144977:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144983:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211839.144989:0:13344:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788211839.155829:0:13344:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788211859.786848:0:13959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788211870.012050:0:14419:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788211870.012134:0:14419:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788211870.012585:0:14419:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ac00108a000 00000020:01000004:3.0:1788211870.012604:0:14419:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788211870.012613:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788211870.012630:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8abff7023370) 00000020:00000080:3.0:1788211870.012645:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788211870.078603:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788211870.089647:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788211870.092487:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 525: rc = 0 00100000:10000000:2.0:1788211870.094432:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788211870.094572:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 525: rc = 0 00100000:10000000:2.0:1788211870.094723:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 525: rc = 0 00100000:10000000:2.0:1788211870.094819:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 525: rc = 0 00100000:10000000:2.0:1788211870.095502:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 525: rc = 0 00100000:10000000:2.0:1788211870.095601:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 525: rc = 0 00100000:10000000:2.0:1788211870.097453:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 527: rc = 0 00100000:10000000:2.0:1788211870.098736:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 493: rc = 0 00100000:10000000:2.0:1788211870.098837:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 493: rc = 0 00100000:10000000:2.0:1788211870.099319:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 357: rc = 0 00100000:10000000:2.0:1788211870.104144:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 357: rc = 0 00100000:10000000:2.0:1788211870.104581:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 357: rc = 0 00100000:10000000:2.0:1788211870.104839:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 357: rc = 0 00100000:10000000:2.0:1788211870.105102:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 357: rc = 0 00100000:10000000:2.0:1788211870.105413:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 357: rc = 0 00100000:10000000:2.0:1788211870.105663:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 357: rc = 0 00100000:10000000:2.0:1788211870.105913:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 357: rc = 0 00100000:10000000:3.0:1788211870.113263:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 357: rc = 0 00100000:10000000:3.0:1788211870.113710:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 357: rc = 0 00100000:10000000:3.0:1788211870.113955:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 357: rc = 0 00100000:10000000:3.0:1788211870.114645:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 357: rc = 0 00100000:10000000:3.0:1788211870.115163:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 509: rc = 0 00100000:10000000:3.0:1788211870.115472:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 509: rc = 0 00100000:10000000:3.0:1788211870.115733:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 509: rc = 0 00100000:10000000:3.0:1788211870.115983:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 509: rc = 0 00100000:10000000:3.0:1788211870.122358:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 509: rc = 0 00100000:10000000:3.0:1788211870.122710:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 509: rc = 0 00100000:10000000:3.0:1788211870.127713:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 509: rc = 0 00100000:10000000:3.0:1788211870.130434:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 509: rc = 0 00100000:10000000:3.0:1788211870.130728:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 509: rc = 0 00100000:10000000:3.0:1788211870.134028:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 509: rc = 0 00100000:10000000:3.0:1788211870.136658:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 509: rc = 0 00100000:10000000:3.0:1788211870.137947:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 509: rc = 0 00100000:10000000:3.0:1788211870.140595:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 509: rc = 0 00100000:10000000:3.0:1788211870.144666:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 509: rc = 0 00100000:10000000:2.0:1788211870.146842:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 509: rc = 0 00100000:10000000:2.0:1788211870.148482:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 509: rc = 0 00100000:10000000:2.0:1788211870.148762:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 509: rc = 0 00100000:10000000:2.0:1788211870.150282:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 509: rc = 0 00100000:10000000:2.0:1788211870.150588:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 509: rc = 0 00100000:10000000:2.0:1788211870.150900:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 509: rc = 0 00100000:10000000:2.0:1788211870.151211:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 509: rc = 0 00100000:10000000:2.0:1788211870.151470:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 509: rc = 0 00100000:10000000:2.0:1788211870.153448:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 509: rc = 0 00100000:10000000:2.0:1788211870.153827:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 509: rc = 0 00100000:10000000:2.0:1788211870.154095:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 509: rc = 0 00100000:10000000:2.0:1788211870.154400:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 509: rc = 0 00100000:10000000:2.0:1788211870.154653:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 509: rc = 0 00100000:10000000:2.0:1788211870.154916:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 509: rc = 0 00100000:10000000:2.0:1788211870.155151:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 509: rc = 0 00100000:10000000:2.0:1788211870.164688:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 509: rc = 0 00100000:10000000:1.0:1788211870.173733:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 509: rc = 0 00100000:10000000:1.0:1788211870.175393:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 509: rc = 0 00100000:10000000:1.0:1788211870.176923:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 371: rc = 0 00100000:10000000:1.0:1788211870.178553:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788211870.178746:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 494: rc = 0 00100000:10000000:1.0:1788211870.180614:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788211870.180710:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 494: rc = 0 00100000:10000000:1.0:1788211870.182451:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788211870.182549:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 494: rc = 0 00100000:10000000:1.0:1788211870.184286:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788211870.184662:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 496: rc = 0 00100000:10000000:1.0:1788211870.186128:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788211870.186278:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 496: rc = 0 00100000:10000000:1.0:1788211870.186491:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788211870.186549:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 496: rc = 0 00000020:00000080:1.0:1788211870.187617:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788211870.187629:0:14419:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788211870.187645:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a650d 00000020:01000004:1.0:1788211870.187654:0:14419:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788211870.187659:0:14419:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788211870.187665:0:14419:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ac00108a000 from MGS 00000020:01000004:1.0:1788211870.187669:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788211870.187681:0:14419:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8abfca8b8000) 00000020:00000080:1.0:1788211870.187694:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788211870.187758:0:14419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac00108a000 from MGS, refs=2 00080000:01000000:1.0:1788211870.187764:0:14419:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788211870.187772:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a651b 00000100:00100000:1.0:1788211870.188117:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788211870.188673:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788211870.188683:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788211870.195508:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788211870.195525:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788211870.198480:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788211870.198693:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788211870.198700:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788211870.204511:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788211870.204525:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788211870.205126:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788211870.205135:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788211870.205704:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211870.205708:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211870.205710:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211870.206318:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211870.206322:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211870.206324:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211870.215817:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788211870.217434:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788211870.257792:0:14419:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788211870.257812:0:14419:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788211870.257821:0:14419:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788211870.269927:0:14428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788211870.270319:0:14419:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788211870.270476:0:14419:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788211870.271467:0:14419:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788211870.271764:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788211870.271972:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788211870.274214:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788211870.277886:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788211870.277897:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788211870.278124:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788211870.278129:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788211870.278825:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788211870.278845:0:14419:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.129@tcp' 00000020:01000004:3.0:1788211870.278847:0:14419:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788211870.278873:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.129@tcp (typ=mgc) 00000020:00000080:3.0:1788211870.278886:0:14419:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.129@tcp (ffff8abff7020000) 00000020:00000080:3.0:1788211870.278902:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788211870.278975:0:14419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abec587e800@MGC192.168.204.129@tcp: add connection 192.168.204.129@tcp at head 00010000:00010000:3.0:1788211870.279116:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.129@tcp-0 is initialized 00000040:01000000:3.0:1788211870.279122:0:14419:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788211870.279368:0:14433:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788211870.285955:0:14434:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788211870.291438:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.129@tcp (uuid 05b7e8c1-59a4-46a9-9396-986dc762646c) 00000020:00000080:3.0:1788211870.291481:0:14419:0:(genops.c:1385:class_connect()) connect: client 05b7e8c1-59a4-46a9-9396-986dc762646c, cookie 0x2afbce82f55a6529 00000100:00080000:3.0:1788211870.291499:0:14419:0:(import.c:510:import_select_connection()) MGC192.168.204.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788211870.291515:0:14419:0:(import.c:624:import_select_connection()) MGC192.168.204.129@tcp: import ffff8abec587e800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1788211870.291556:0:14419:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001203800 x1875075660864000/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788211870.291642:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:05b7e8c1-59a4-46a9-9396-986dc762646c:3307:1875075660864000:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788211870.291737:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211870.292437:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660864000 00000100:00100000:0.0:1788211870.292447:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660864000 00000100:00100000:0.0:1788211870.292574:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788211870.292583:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1875075660864000:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788211870.292611:0:14430:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 05b7e8c1-59a4-46a9-9396-986dc762646c@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1788211870.292638:0:14430:0:(genops.c:1385:class_connect()) connect: client 05b7e8c1-59a4-46a9-9396-986dc762646c, cookie 0x2afbce82f55a6530 00000100:00080000:0.0:1788211870.292803:0:14430:0:(import.c:65:import_set_state_nolock()) ffff8abfc542b800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788211870.293037:0:14419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 05b7e8c1-59a4-46a9-9396-986dc762646c->MGS 00000020:01000004:3.0:1788211870.293066:0:14419:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788211870.293073:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788211870.293089:0:14419:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8abff70219b8) 00000020:00000080:3.0:1788211870.293102:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788211870.305867:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+5:3307:x1875075660864000:12345-0@lo:250:mount.lustre.0 Request processed in 13253us (14099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211870.305886:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788211870.306156:0:3307:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788211870.306195:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.129@tcp: connect to target with instance 0 00000100:00080000:2.0:1788211870.306207:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788211870.306214:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788211870.306220:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788211870.306225:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788211870.306258:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788211870.306266:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:05b7e8c1-59a4-46a9-9396-986dc762646c:3307:1875075660864000:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788211870.311374:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211870.311601:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788211870.311609:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788211870.313463:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788211870.313478:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788211870.314060:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788211870.314068:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788211870.315218:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211870.315456:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788211870.315463:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788211870.316764:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788211870.316774:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788211870.371523:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211870.371736:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788211870.371743:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788211870.375356:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788211870.375379:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788211870.376431:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211870.376620:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788211870.376627:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788211870.377597:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788211870.377608:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788211870.378510:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211870.378689:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788211870.378696:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788211870.379662:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788211870.379672:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788211870.383144:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211870.383437:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788211870.383444:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788211870.384326:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788211870.384335:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788211870.408644:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211870.408890:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788211870.408896:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788211870.410674:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788211870.410691:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788211870.414569:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788211870.414586:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788211870.415900:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788211870.415924:0:14419:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788211870.415931:0:14419:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788211870.416081:0:14419:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788211870.416119:0:14419:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.129@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788211870.416124:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788211870.416125:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788211870.416127:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211870.416128:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211870.416130:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211870.416131:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211870.416132:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788211870.416134:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788211870.416136:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211870.416137:0:14419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788211870.416140:0:14419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788211870.416143:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788211870.416145:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788211870.416146:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211870.416147:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211870.416149:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211870.416150:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211870.416151:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788211870.416152:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788211870.416153:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211870.416155:0:14419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788211870.417939:0:14419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788211870.417969:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864128:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788211870.418074:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211870.418130:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc59a9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788211870.418474:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660864128 00000100:00100000:2.0:1788211870.418484:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660864128 00000100:00100000:2.0:1788211870.418546:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211870.418557:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+5:14419:x1875075660864128:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788211870.418603:0:14432:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788211870.418606:0:14432:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788211870.418609:0:14432:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788211870.419497:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788211870.419988:0:14432:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788211870.422013:0:14454:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788211870.422023:0:14454:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788211870.422026:0:14454:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788211870.422061:0:14454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788211870.422733:0:14432:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788211870.422745:0:14432:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788211870.438012:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+5:14419:x1875075660864128:12345-0@lo:253:mount.lustre.0 Request processed in 19443us (19924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211870.438055:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788211870.438208:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864128:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788211870.438230:0:14419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788211870.438234:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788211870.438245:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788211870.438246:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788211870.438248:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788211870.438249:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788211870.438250:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788211870.438252:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788211870.438254:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788211870.438257:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788211870.438258:0:14419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788211870.438286:0:14419:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ac00108a000 from lustre-MDT0000 10000000:01000000:1.0:1788211870.438312:0:14419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788211870.438315:0:14419:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788211870.438319:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8abff7020000 10000000:01000000:1.0:1788211870.438487:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788211870.438497:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8abff7020000 from 1 10000000:01000000:1.0:1788211870.438500:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788211870.438548:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.438560:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.438570:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211870.438588:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864256:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788211870.438627:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211870.438663:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788211870.438794:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660864256 00000100:00100000:0.0:1788211870.438801:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660864256 00000100:00100000:0.0:1788211870.438841:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788211870.438850:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+5:14419:x1875075660864256:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788211870.438863:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211870.438876:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfca8cca00/0x2afbce82f55a6545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a653e expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.438896:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfca8cca00/0x2afbce82f55a6545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a653e expref: 6 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.438918:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfca8cca00/0x2afbce82f55a6545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a653e expref: 6 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.438928:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cca00, rc 0) 00000100:00100000:0.0:1788211870.438960:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+6:14419:x1875075660864256:12345-0@lo:101:mount.lustre.0 Request processed in 111us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211870.438965:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788211870.440084:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864256:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788211870.440119:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.440129:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211870.440246:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211870.440307:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211870.440706:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788211870.440994:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660864384 00000100:00100000:0.0:1788211870.441006:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660864384 00000100:00100000:0.0:1788211870.441069:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788211870.441079:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+6:14419:x1875075660864384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788211870.441631:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+6:14419:x1875075660864384:12345-0@lo:501:mount.lustre.0 Request processed in 550us (1322us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788211870.441641:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788211870.442562:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864384:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788211870.442608:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788211870.442622:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.442632:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211870.442642:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ac00108a000 10000000:01000000:1.0:1788211870.442647:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788211870.442662:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ac00108a000 10000000:01000000:1.0:1788211870.442665:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788211870.442668:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ac00108a000 from 1 10000000:01000000:1.0:1788211870.442671:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788211870.442705:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.442713:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.442742:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211870.442768:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788211870.442817:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211870.442860:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660864512 00000100:00100000:1.0:1788211870.442867:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660864512 00000100:00100000:1.0:1788211870.442901:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788211870.442910:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+6:14419:x1875075660864512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788211870.442924:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211870.442941:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a6553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a654c expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.442967:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a6553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a654c expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.442978:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a6553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a654c expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.442989:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b800, rc 0) 00000100:00100000:1.0:1788211870.443020:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+7:14419:x1875075660864512:12345-0@lo:101:mount.lustre.0 Request processed in 111us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211870.443027:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788211870.443069:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788211870.443083:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788211870.443096:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.443112:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211870.443126:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788211870.443130:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.443136:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211870.443143:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788211870.443146:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788211870.443151:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ac00108a000 10000000:01000000:1.0:1788211870.443154:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788211870.443157:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788211870.443159:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788211870.443605:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.443615:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.443622:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211870.443635:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788211870.444134:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211870.444404:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660864640 00000100:00100000:0.0:1788211870.444414:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660864640 00000100:00100000:0.0:1788211870.444465:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788211870.444474:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+7:14419:x1875075660864640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788211870.444489:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211870.444504:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfca8ccc00/0x2afbce82f55a6561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a655a expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.444527:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfca8ccc00/0x2afbce82f55a6561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a655a expref: 8 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.444538:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfca8ccc00/0x2afbce82f55a6561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a655a expref: 8 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.444562:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8ccc00, rc 0) 00000100:00100000:0.0:1788211870.444602:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+8:14419:x1875075660864640:12345-0@lo:101:mount.lustre.0 Request processed in 129us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211870.444609:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788211870.444865:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788211870.444889:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788211870.444902:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.444910:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211870.444971:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211870.444998:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211870.445011:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788211870.445063:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660864768 00000100:00100000:0.0:1788211870.445067:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660864768 00000100:00100000:0.0:1788211870.445097:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788211870.445105:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+8:14419:x1875075660864768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788211870.448160:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+9:14419:x1875075660864768:12345-0@lo:501:mount.lustre.0 Request processed in 3045us (3151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211870.448202:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788211870.449832:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211870.449910:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211870.450014:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211870.450140:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788211870.450625:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660864896 00000100:00100000:2.0:1788211870.450634:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660864896 00000100:00100000:2.0:1788211870.450820:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788211870.450834:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+9:14419:x1875075660864896:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788211870.451580:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+9:14419:x1875075660864896:12345-0@lo:503:mount.lustre.0 Request processed in 744us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211870.451591:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788211870.451940:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660864896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211870.452810:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05b7e8c1-59a4-46a9-9396-986dc762646c:14455:1875075660865024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788211870.452881:0:14455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211870.452972:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211870.453010:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660865024 00000100:00100000:0.0:1788211870.453018:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660865024 00000100:00100000:0.0:1788211870.453097:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788211870.453107:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+9:14455:x1875075660865024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211870.453578:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+9:14455:x1875075660865024:12345-0@lo:502:llog_process_th.0 Request processed in 471us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211870.453587:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788211870.453685:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05b7e8c1-59a4-46a9-9396-986dc762646c:14455:1875075660865024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788211870.453713:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211870.453727:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211870.453729:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788211870.453737:0:14455:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788211870.453739:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788211870.453753:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8abfca8a4d28) 00000020:00000080:2.0:1788211870.453773:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788211870.453778:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788211870.453848:0:14455:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788211870.453855:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a656f 00000020:00000080:2.0:1788211870.454082:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788211870.454086:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211870.454090:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211870.454092:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788211870.454095:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211870.454099:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211870.454101:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788211870.454104:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788211870.454112:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8abfca8a19b8) 00000020:00000080:2.0:1788211870.454122:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788211870.454135:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788211870.454138:0:14455:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788211870.454141:0:14455:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788211870.454149:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788211870.454714:0:14455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac00108a000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788211870.454732:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8abfca8a0000) 00000020:00000080:2.0:1788211870.454741:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788211870.454792:0:14455:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788211870.454799:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a6584 00000020:00000080:2.0:1788211870.454904:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788211870.454911:0:14455:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788211870.454916:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2afbce82f55a658b 00080000:01000000:2.0:1788211870.454921:0:14455:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788211870.454925:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a6592 00010000:00010000:3.0:1788211870.561657:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788211870.564309:0:14455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1788211870.565377:0:14455:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788211870.565998:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8abfca8a3370) 00000020:00000080:2.0:1788211870.567120:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788211870.567508:0:14455:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788211870.567519:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a65a0 00000020:00000080:2.0:1788211870.569845:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788211870.585149:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2afbce82f55a65a7 00000020:00000080:2.0:1788211870.586549:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788211870.586563:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211870.586571:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211870.586574:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788211870.586578:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788211870.586581:0:14455:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788211870.586583:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788211870.586585:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788211870.586586:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788211870.586589:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211870.586590:0:14455:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788211870.586593:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211870.586610:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211870.586611:0:14455:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788211870.586618:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788211870.586801:0:14455:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788211870.586818:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211870.586822:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211870.586824:0:14455:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788211870.586827:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788211870.586831:0:14455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788211870.586834:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211870.586836:0:14455:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788211870.586839:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788211870.586845:0:14455:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.129@tcp to nid 0x20000c0a8cc81 (192.168.204.129@tcp) 00000020:01000000:2.0:1788211870.586874:0:14455:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788211870.586877:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788211870.586904:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8abfd83619b8) 00000020:00000080:2.0:1788211870.586923:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788211870.586929:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788211870.586984:0:14455:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788211870.586990:0:14455:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788211870.586996:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a65b5 00010000:00080000:2.0:1788211870.587093:0:14455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abff600f800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:2.0:1788211870.587602:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788211870.591389:0:14455:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788211870.591482:0:14455:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788211870.593913:0:14455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788211870.594096:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788211870.594272:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788211870.600108:0:14459:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788211870.600119:0:14459:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788211870.607296:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788211870.607315:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788211870.607359:0:14455:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788211870.607383:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a65bc 00000100:00080000:1.0:1788211870.607400:0:14455:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788211870.607406:0:14455:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8abff600f800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211870.607451:0:14455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001364380 x1875075660865152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788211870.607482:0:14455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788211870.607579:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211870.607583:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211870.607585:0:14455:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788211870.607588:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788211870.607591:0:14455:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788211870.607593:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788211870.607595:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788211870.607597:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788211870.607600:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211870.607601:0:14455:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788211870.607603:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788211870.607608:0:14455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788211870.607611:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211870.607612:0:14455:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788211870.607615:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788211870.607619:0:14455:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.129@tcp to nid 0x20000c0a8cc81 (192.168.204.129@tcp) 00000020:01000000:1.0:1788211870.607646:0:14455:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788211870.607648:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788211870.607662:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8abfca8b99b8) 00000020:00000080:1.0:1788211870.607672:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788211870.607677:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788211870.607755:0:14455:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788211870.607761:0:14455:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788211870.607767:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a65ca 00010000:00080000:1.0:1788211870.607799:0:14455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abfe472f000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:1.0:1788211870.608012:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788211870.608295:0:14455:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788211870.608322:0:14455:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788211870.609140:0:14455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788211870.609267:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788211870.609356:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1788211870.609638:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660865152:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788211870.609715:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875075660865152 offset 0 length 520: 4 00000040:00080000:2.0:1788211870.610883:0:14461:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788211870.610899:0:14461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788211870.611777:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788211870.611793:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788211870.611830:0:14455:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788211870.611854:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a65d1 00000100:00080000:0.0:1788211870.611868:0:14455:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788211870.611876:0:14455:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8abfe472f000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1788211870.611926:0:14455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfca879180 x1875075660865280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788211870.611956:0:14455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788211870.612023:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211870.612028:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211870.612029:0:14455:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788211870.612032:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211870.612036:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211870.612037:0:14455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788211870.612040:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788211870.612042:0:14455:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788211870.612044:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211870.612046:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211870.612048:0:14455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788211870.612049:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211870.612051:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211870.612052:0:14455:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788211870.612056:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788211870.612096:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05b7e8c1-59a4-46a9-9396-986dc762646c:14455:1875075660865408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211870.612219:0:14455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211870.612266:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4ad9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211870.612451:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660865280:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788211870.612494:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875075660865280 offset 0 length 520: 4 00000100:00100000:2.0:1788211870.612526:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660865408 00000100:00100000:2.0:1788211870.612532:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660865408 00000100:00100000:2.0:1788211870.612587:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788211870.612597:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+9:14455:x1875075660865408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211870.612844:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+9:14455:x1875075660865408:12345-0@lo:502:llog_process_th.0 Request processed in 249us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211870.612852:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788211870.613674:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05b7e8c1-59a4-46a9-9396-986dc762646c:14455:1875075660865408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788211870.613706:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211870.613712:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211870.613714:0:14455:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788211870.613718:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788211870.615788:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788211870.616419:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788211870.616449:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.616463:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211870.616472:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ac00108a000 from 1 10000000:01000000:3.0:1788211870.616475:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788211870.617079:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.617091:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.617103:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211870.617133:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660865536:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788211870.617253:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211870.617306:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc59a9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788211870.617317:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660865536 00000100:00100000:0.0:1788211870.617327:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660865536 00000100:00100000:0.0:1788211870.617393:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788211870.617404:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+9:14419:x1875075660865536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788211870.617430:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211870.617446:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a65df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a65d8 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.617473:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a65df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a65d8 expref: 10 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.617486:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a65df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a65d8 expref: 10 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.617496:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc600, rc 0) 00000100:00100000:0.0:1788211870.617566:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+10:14419:x1875075660865536:12345-0@lo:101:mount.lustre.0 Request processed in 155us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211870.617574:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788211870.617772:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660865536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788211870.617788:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a65df expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.617797:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a65df expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211870.619976:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660865664:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788211870.620483:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211870.620581:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc59a9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788211870.620695:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660865664 00000100:00100000:0.0:1788211870.620703:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660865664 00000100:00100000:0.0:1788211870.620795:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788211870.620806:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+10:14419:x1875075660865664:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788211870.620828:0:14430:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788211870.620835:0:14430:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788211870.620926:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+10:14419:x1875075660865664:12345-0@lo:256:mount.lustre.0 Request processed in 122us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211870.620934:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788211870.621023:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660865664:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788211870.621635:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788211870.621661:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a65df expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.621671:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a65df expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211870.621679:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ac00108a000 from 1 10000000:01000000:3.0:1788211870.621682:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788211870.621711:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.621718:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.621727:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211870.621802:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660865792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788211870.621840:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211870.622931:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc59a9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788211870.623105:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660865792 00000100:00100000:2.0:1788211870.623114:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660865792 00000100:00100000:2.0:1788211870.623303:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788211870.623316:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+10:14419:x1875075660865792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788211870.623337:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211870.623361:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abff63c7a00/0x2afbce82f55a65ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a65e6 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211870.623388:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abff63c7a00/0x2afbce82f55a65ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a65e6 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211870.623399:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abff63c7a00/0x2afbce82f55a65ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a65e6 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211870.623408:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7a00, rc 0) 00000100:00100000:2.0:1788211870.623480:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+11:14419:x1875075660865792:12345-0@lo:101:mount.lustre.0 Request processed in 167us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211870.623547:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660865792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788211870.623588:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a65ed expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.623597:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a65ed expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211870.623667:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660865920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211870.623706:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211870.623723:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788211870.625328:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660865920 00000100:00100000:0.0:1788211870.625352:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660865920 00000100:00100000:2.0:1788211870.627644:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788211870.627740:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788211870.627772:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14419:x1875075660865920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788211870.628316:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14419:x1875075660865920:12345-0@lo:501:mount.lustre.0 Request processed in 554us (4608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211870.628331:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788211870.628394:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660865920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211870.628470:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660866048:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211870.628522:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211870.628559:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788211870.630461:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660866048 00000100:00100000:3.0:1788211870.630477:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660866048 00000100:00100000:3.0:1788211870.630529:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788211870.630539:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14419:x1875075660866048:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788211870.630939:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14419:x1875075660866048:12345-0@lo:503:mount.lustre.0 Request processed in 400us (2415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211870.631001:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788211870.631120:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660866048:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211870.632006:0:14463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05b7e8c1-59a4-46a9-9396-986dc762646c:14463:1875075660866176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788211870.632074:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211870.632115:0:14463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211870.632215:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660866176 00000100:00100000:2.0:1788211870.632223:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660866176 00000100:00100000:2.0:1788211870.632263:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788211870.632272:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+11:14463:x1875075660866176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211870.632507:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+11:14463:x1875075660866176:12345-0@lo:502:llog_process_th.0 Request processed in 236us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211870.632514:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788211870.632815:0:14463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05b7e8c1-59a4-46a9-9396-986dc762646c:14463:1875075660866176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788211870.632844:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788211870.632854:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211870.632856:0:14463:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788211870.632862:0:14463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac00108a000 00000020:00000080:1.0:1788211870.632865:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788211870.632872:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211870.632875:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211870.632876:0:14463:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788211870.632883:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788211870.632885:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211870.632887:0:14463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788211870.632890:0:14463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac00108a000 00000020:00000080:1.0:1788211870.632893:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788211870.633794:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211870.633806:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211870.633808:0:14463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788211870.633811:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788211870.633814:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211870.633816:0:14463:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788211870.633820:0:14463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac00108a000 00000020:00000080:1.0:1788211870.633822:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788211870.645594:0:14463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05b7e8c1-59a4-46a9-9396-986dc762646c:14463:1875075660866304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788211870.645676:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211870.645835:0:14463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788211870.654188:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660866304 00000100:00100000:3.0:1788211870.654207:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660866304 00000100:00100000:3.0:1788211870.654281:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788211870.654293:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+11:14463:x1875075660866304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211870.654628:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+11:14463:x1875075660866304:12345-0@lo:502:llog_process_th.0 Request processed in 337us (8950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211870.654637:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788211870.657853:0:14463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05b7e8c1-59a4-46a9-9396-986dc762646c:14463:1875075660866304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788211870.657907:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211870.657917:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211870.657919:0:14463:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788211870.657925:0:14463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788211870.658844:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788211870.658871:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788211870.658901:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a65ed expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211870.658915:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a65ed expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211870.658989:0:14419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788211870.658994:0:14419:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ac00108a000 10000000:01000000:2.0:1788211870.658998:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ac00108a000 10000000:01000000:2.0:1788211870.659004:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788211870.659012:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ac00108a000 from 1 10000000:01000000:2.0:1788211870.659015:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788211870.659064:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211870.659090:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211870.659100:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211870.659122:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660866432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788211870.659224:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211870.659280:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b460c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211870.659692:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660866432 00000100:00100000:3.0:1788211870.659701:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660866432 00000100:00100000:3.0:1788211870.660695:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788211870.660716:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+11:14419:x1875075660866432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788211870.660921:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211870.661030:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6063400/0x2afbce82f55a65fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a65f4 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.661068:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6063400/0x2afbce82f55a65fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a65f4 expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.661090:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6063400/0x2afbce82f55a65fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a65f4 expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.661100:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063400, rc 0) 00000100:00100000:3.0:1788211870.661208:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14419:x1875075660866432:12345-0@lo:101:mount.lustre.0 Request processed in 499us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211870.661216:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788211870.661707:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660866432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788211870.661726:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211870.661735:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211870.661821:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660866560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788211870.661862:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211870.661897:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b460c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211870.662206:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660866560 00000100:00100000:1.0:1788211870.662215:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660866560 00000100:00100000:1.0:1788211870.662269:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788211870.662279:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14419:x1875075660866560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211870.662540:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14419:x1875075660866560:12345-0@lo:501:mount.lustre.0 Request processed in 263us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211870.662549:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788211870.663277:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660866560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788211870.663320:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660866688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788211870.663373:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211870.663402:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211870.663420:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660866688 00000100:00100000:2.0:1788211870.663425:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660866688 00000100:00100000:2.0:1788211870.663661:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788211870.663679:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14419:x1875075660866688:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788211870.663895:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14419:x1875075660866688:12345-0@lo:503:mount.lustre.0 Request processed in 217us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211870.663904:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788211870.665881:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660866688:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788211870.674096:0:14468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05b7e8c1-59a4-46a9-9396-986dc762646c:14468:1875075660866816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211870.674471:0:14468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211870.674656:0:14468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8505cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211870.677120:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660866816 00000100:00100000:2.0:1788211870.677141:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660866816 00000100:00100000:2.0:1788211870.677243:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788211870.677259:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14468:x1875075660866816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211870.679905:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14468:x1875075660866816:12345-0@lo:502:llog_process_th.0 Request processed in 2643us (5425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211870.679920:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788211870.680012:0:14468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05b7e8c1-59a4-46a9-9396-986dc762646c:14468:1875075660866816:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788211870.680084:0:14468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788211870.680100:0:14468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8abfd8364d28) 00000020:00000080:2.0:1788211870.680120:0:14468:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788211870.680238:0:14468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac00108a000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788211870.680243:0:14468:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac00108a000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788211870.680246:0:14468:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ac00108a000 4 00010000:00080000:2.0:1788211870.680277:0:14468:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abfd854e000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:2.0:1788211870.684979:0:14468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788211870.685224:0:14468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788211870.685277:0:14468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788211870.685293:0:14468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2afbce82f55a6609 00000100:00080000:2.0:1788211870.685305:0:14468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788211870.685312:0:14468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8abfd854e000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1788211870.685356:0:14468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfef635f80 x1875075660866944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788211870.685382:0:14468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788211870.685423:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660866944:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788211870.685495:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211870.688820:0:14468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef637800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05b7e8c1-59a4-46a9-9396-986dc762646c:14468:1875075660867072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211870.688970:0:14468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211870.689028:0:14468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec6752900 going to sleep for 11 seconds 00000100:00100000:2.0:1788211870.689055:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660867072 00000100:00100000:2.0:1788211870.689063:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660867072 00000100:00100000:2.0:1788211870.689108:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788211870.689120:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14468:x1875075660867072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211870.689721:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660866944 00000100:00100000:3.0:1788211870.689730:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660866944 00000100:00100000:3.0:1788211870.689768:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788211870.689774:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875075660866944:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788211870.689848:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875075660866944:12345-0@lo:38:llog_process_th.0 Request processed in 73us (4352us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788211870.689856:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788211870.689945:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788211870.689955:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfd854e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788211870.689960:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788211870.689964:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660866944:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788211870.691913:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14468:x1875075660867072:12345-0@lo:502:llog_process_th.0 Request processed in 2784us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211870.691927:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788211870.693492:0:14468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef637800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05b7e8c1-59a4-46a9-9396-986dc762646c:14468:1875075660867072:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788211870.693538:0:14468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788211870.693796:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788211870.693825:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788211870.693884:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211870.693896:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788211870.693954:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788211870.693957:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788211870.693958:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211870.693959:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211870.693965:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211870.693966:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211870.693967:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788211870.693969:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788211870.693972:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211870.693973:0:14419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788211870.693976:0:14419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788211870.693978:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788211870.693979:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788211870.693980:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211870.693981:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211870.693982:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211870.693982:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211870.693983:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788211870.693984:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788211870.693985:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211870.693986:0:14419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788211870.694021:0:14419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788211870.694042:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660867200:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788211870.694107:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211870.694143:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec6752840 going to sleep for 11 seconds 00000100:00100000:2.0:1788211870.694364:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660867200 00000100:00100000:2.0:1788211870.694372:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660867200 00000100:00100000:2.0:1788211870.694421:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788211870.694430:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14419:x1875075660867200:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788211870.694460:0:14430:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788211870.694477:0:14430:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788211870.780996:0:14430:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788211870.781095:0:14430:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788211870.783216:0:14453:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788211870.783238:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788211870.783270:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.783291:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a65df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a65d8 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.783301:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.783351:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a65df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a65d8 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.783381:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a65df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a65d8 expref: 12 pid: 14432 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211870.783396:0:14453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1875075660867328:0@lo:104: 00000100:00100000:3.0:1788211870.783466:0:14453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211870.783520:0:14453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788211870.783911:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660867328 00000100:00100000:0.0:1788211870.783921:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660867328 00000100:00100000:0.0:1788211870.783977:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788211870.783987:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+3:14453:x1875075660867328:12345-0@lo:104: 00010000:00010000:0.0:1788211870.784003:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a65df expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.784068:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788211870.784075:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+3:14453:x1875075660867328:12345-0@lo:104: Request processed in 89us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211870.784082:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788211870.784101:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211870.784106:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a65df expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.784114:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062000 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211870.784118:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a65df expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.784139:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a65df expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211870.784147:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a65df expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211870.784153:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788211870.784202:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a65df expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.784209:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211870.784227:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a65df expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.784246:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abec6062000/0x2afbce82f55a65d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a65df expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211870.784265:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211870.784267:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211870.784269:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211870.784367:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660867456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788211870.784402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211870.784461:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660867456 00000100:00100000:1.0:1788211870.784466:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660867456 00010000:00010000:1.0:1788211870.784489:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a65df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a65d8 expref: 13 pid: 14432 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211870.784525:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788211870.784533:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+13:3309:x1875075660867456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788211870.784543:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211870.784549:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a65df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a65d8 expref: 13 pid: 14432 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.784559:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a65df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a65d8 expref: 13 pid: 14432 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.784578:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.784584:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788211870.784597:0:14422:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001369620s 00010000:00010000:1.0:1788211870.784602:0:14422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.784608:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.784615:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.784621:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.784627:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788211870.784638:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.784644:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.784653:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211870.784663:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211870.784694:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+13:3309:x1875075660867456:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211870.784701:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788211870.784758:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660867456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211870.785049:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a65df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a65d8 expref: 12 pid: 14432 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211870.785060:0:14453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1875075660867328:0@lo:104: 00010000:00010000:3.0:1788211870.785073:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.785082:0:14453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.785087:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211870.785092:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a6610 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211870.820871:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+11:14419:x1875075660867200:12345-0@lo:253:mount.lustre.0 Request processed in 126430us (126751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211870.820890:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788211870.821019:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:14419:1875075660867200:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788211870.821041:0:14419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788211870.821045:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788211870.821047:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788211870.821048:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211870.821050:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211870.821051:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211870.821070:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211870.821071:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788211870.821073:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788211870.821074:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211870.821076:0:14419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788211870.821095:0:14419:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788211870.829034:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211870.829225:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788211870.829498:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211870.829649:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788211870.829895:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211870.830046:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788211870.832099:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788211870.832323:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788211870.832569:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788211870.832824:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788211870.833096:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788211870.833348:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788211870.913420:0:14419:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788211870.916864:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788211870.917208:0:14474:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788211870.917213:0:14474:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788211870.917448:0:14475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788211870.917582:0:14475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788211870.919587:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788211870.919698:0:14475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788211870.919704:0:14475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788211870.922408:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788211870.922553:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788211870.924333:0:14419:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788211870.924481:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788211870.924905:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788211870.928757:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788211870.929384:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788211870.929421:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788211870.929966:0:14419:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1788211870.937324:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788211870.952815:0:14419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788211871.047503:0:14419:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788211871.047548:0:14419:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa765c1cc3988 00100000:10000000:1.0:1788211871.047560:0:14419:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788211871.048716:0:14419:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788211871.048732:0:14419:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788211871.048744:0:14419:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788211871.048767:0:14419:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788211871.271488:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788211871.717980:0:14469:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788211871.717992:0:14469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788211871.718470:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788211871.718479:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:1.0:1788211872.104878:0:14434:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788211872.104885:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ac00108a000 from 6 10000000:01000000:1.0:1788211872.104889:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788211872.104935:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211872.104947:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211872.104959:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211872.104982:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660867584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788211872.105051:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211872.105101:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe1133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211872.105151:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660867584 00000100:00100000:3.0:1788211872.105158:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660867584 00000100:00100000:3.0:1788211872.105439:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788211872.105450:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+11:14434:x1875075660867584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788211872.105464:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211872.105478:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a661e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6617 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211872.105499:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a661e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6617 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211872.105510:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a661e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6617 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211872.105530:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062a00, rc 0) 00000100:00100000:3.0:1788211872.105581:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14434:x1875075660867584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211872.105589:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788211872.105657:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660867584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211872.105672:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a661e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211872.105680:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a661e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211872.105738:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660867712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788211872.105769:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211872.111065:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe1133c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211872.111255:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660867712 00000100:00100000:0.0:1788211872.111265:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660867712 00000100:00100000:1.0:1788211872.114988:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788211872.115005:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14434:x1875075660867712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788211872.115043:0:14431:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788211872.115063:0:14431:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788211872.115066:0:14431:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788211872.115297:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14434:x1875075660867712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 295us (9525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211872.115305:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788211872.115361:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660867712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788211872.115446:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788211872.115460:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a661e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211872.115473:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a661e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211872.294213:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788211872.743397:0:14469:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788211872.743409:0:14469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788211872.743950:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788211872.744015:0:14469:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788211872.744047:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1788211873.318874:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211874.341619:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211875.368986:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788211875.902236:0:14718:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788211876.071611:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788211876.071631:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788211876.071634:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788211876.071637:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788211876.071641:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788211876.071645:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788211876.071650:0:36:0:(import.c:65:import_set_state_nolock()) ffff8abfd854e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788211876.071666:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8abfd854e000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1788211876.071692:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfef636d80 x1875075660867968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788211876.071747:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788211876.071765:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660867840:0@lo:400:kworker.0 00000100:00100000:2.0:1788211876.071858:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211876.071966:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660867968:0@lo:38:kworker.0 00000100:00100000:2.0:1788211876.072003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211876.072046:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660867840 00000100:00100000:2.0:1788211876.072055:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660867840 00000100:00100000:2.0:1788211876.072107:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788211876.072118:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:3311:x1875075660867840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211876.072218:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:3311:x1875075660867840:12345-0@lo:400:kworker.0 Request processed in 101us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211876.072240:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788211876.072303:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660867968 00000100:00100000:2.0:1788211876.072307:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660867968 00000100:00100000:2.0:1788211876.072333:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211876.072338:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875075660867968:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788211876.072960:0:14439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:2.0:1788211876.073006:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2afbce82f55a6625 00000004:00100000:2.0:1788211876.073025:0:14439:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788211876.073303:0:14439:0:(import.c:65:import_set_state_nolock()) ffff8abfcacbc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211876.073367:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875075660867968:12345-0@lo:38:kworker.0 Request processed in 1025us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211876.073376:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788211876.073428:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8abfef636d80 x1875075660867968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788211886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788211876.073447:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788211876.073456:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788211876.073461:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788211876.073464:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfd854e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788211876.073471:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660867968:0@lo:38:kworker.0 00000100:00100000:2.0:1788211876.073520:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660867840:0@lo:400:kworker.0 00010000:00010000:1.0:1788211876.396820:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211877.413405:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211878.463795:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788211879.297953:0:14870:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcc0c24d0 20000000:00000080:3.0:1788211879.297978:0:14870:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8abfd829ec00 uarg=0000000000000000 20000000:01000000:3.0:1788211879.298020:0:14870:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788211879.298028:0:14870:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788211879.298034:0:14870:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788211879.301455:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788211879.301907:0:14870:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788211879.315977:0:14870:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788211879.316026:0:14870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211879.316054:0:14870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abff63c7a00/0x2afbce82f55a65ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a65e6 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211879.316073:0:14870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211879.316157:0:14870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abff63c7a00/0x2afbce82f55a65ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a65e6 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211879.317269:0:14870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abff63c7a00/0x2afbce82f55a65ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a65e6 expref: 11 pid: 14432 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211879.317296:0:14870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14870:1875075660868096:0@lo:104: 00000100:00100000:3.0:1788211879.317420:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211879.317590:0:14870:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffbc4d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788211879.317833:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660868096 00000100:00100000:0.0:1788211879.317844:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660868096 00000100:00100000:0.0:1788211879.317901:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788211879.317911:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05b7e8c1-59a4-46a9-9396-986dc762646c+3:14870:x1875075660868096:12345-0@lo:104: 00010000:00010000:0.0:1788211879.317933:0:14421:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a65ed expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211879.318003:0:14421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788211879.318011:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05b7e8c1-59a4-46a9-9396-986dc762646c+3:14870:x1875075660868096:12345-0@lo:104: Request processed in 102us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211879.318019:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788211879.318039:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211879.318048:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a65ed expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318060:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062400 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:2.0:1788211879.318090:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a65ed expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318101:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a65ed expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211879.318108:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a65ed expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211879.318114:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788211879.318188:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a65ed expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318195:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788211879.318220:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a65ed expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318227:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a65e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a65ed expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318250:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211879.318252:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211879.318253:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211879.318265:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660868224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788211879.318304:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211879.318348:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660868224 00000100:00100000:2.0:1788211879.318353:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660868224 00010000:00010000:2.0:1788211879.318373:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abff63c7a00/0x2afbce82f55a65ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a65e6 expref: 12 pid: 14432 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211879.318400:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211879.318417:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:3311:x1875075660868224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788211879.318428:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211879.318435:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abff63c7a00/0x2afbce82f55a65ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a65e6 expref: 12 pid: 14432 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318445:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abff63c7a00/0x2afbce82f55a65ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a65e6 expref: 12 pid: 14432 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318464:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318472:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318500:0:14422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318508:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318515:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318520:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318526:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211879.318530:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318537:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318553:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211879.318698:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211879.318743:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:3311:x1875075660868224:12345-0@lo:103:ldlm_bl.0 Request processed in 327us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211879.318751:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788211879.318981:0:14870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abff63c7a00/0x2afbce82f55a65ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a65e6 expref: 11 pid: 14432 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211879.318995:0:14870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14870:1875075660868096:0@lo:104: 00010000:00010000:1.0:1788211879.319020:0:14870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211879.319030:0:14870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211879.319036:0:14870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211879.319052:0:14870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6062e00/0x2afbce82f55a662c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211879.319334:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660868224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788211879.461599:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211880.167433:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788211870/real 1788211870] req@ffff8abfca879180 x1875075660865280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788211880 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211880.167465:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8abfca879180 x1875075660865280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788211880 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211880.167477:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788211870/real 1788211870] req@ffff8ac001364380 x1875075660865152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788211880 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211880.167488:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac001364380 x1875075660865152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788211880 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788211880.167506:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfe472f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788211880.167531:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788211880.167546:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660865280:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788211880.167552:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abff600f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788211880.167557:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788211880.167560:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660865152:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788211880.167670:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788211880.167674:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788211880.167677:0:38:0:(import.c:65:import_set_state_nolock()) ffff8abff600f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788211880.167683:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:1.0:1788211880.167688:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788211880.167696:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8abff600f800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211880.167721:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001364700 x1875075660868480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788211880.167732:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788211880.167735:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788211880.167737:0:38:0:(import.c:65:import_set_state_nolock()) ffff8abfe472f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788211880.167739:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:1.0:1788211880.167742:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788211880.167745:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8abfe472f000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211880.167754:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001365880 x1875075660868608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788211880.167784:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660868736:0@lo:400:kworker.0 00000100:00100000:1.0:1788211880.167856:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211880.167913:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788211880.167919:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660868352:0@lo:400:kworker.0 00000100:00100000:1.0:1788211880.167959:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211880.168031:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660868352 00000100:00100000:0.0:1788211880.168040:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660868352 00000100:00100000:0.0:1788211880.168108:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788211880.168118:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+11:3309:x1875075660868352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211880.168197:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+11:3309:x1875075660868352:12345-0@lo:400:kworker.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211880.168204:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788211880.168234:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660868480:0@lo:8:kworker.0 00000400:00000100:0.0:1788211880.168255:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875075660868480 offset 0 length 520: 4 00000100:00100000:0.0:1788211880.168269:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660868608:0@lo:8:kworker.0 00000400:00000100:0.0:1788211880.168286:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875075660868608 offset 0 length 520: 4 00000100:00100000:0.0:1788211880.168320:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660868352:0@lo:400:kworker.0 00000100:00100000:3.0:1788211880.169240:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660868736 00000100:00100000:3.0:1788211880.169249:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660868736 00000100:00100000:3.0:1788211880.169298:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788211880.169306:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660868736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211880.169368:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660868736:12345-0@lo:400:kworker.0 Request processed in 63us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211880.169375:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788211880.169509:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ac001364000 x1875075660868736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211880.169522:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660868736:0@lo:400:kworker.0 00010000:00010000:2.0:1788211880.487190:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788211881.318225:0:14434:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788211881.318233:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ac00108a000 from 10 10000000:01000000:0.0:1788211881.318239:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788211881.318305:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211881.318335:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211881.318350:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211881.318383:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660868864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788211881.318506:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211881.318555:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788211881.318980:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660868864 00000100:00100000:2.0:1788211881.318989:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660868864 00000100:00100000:2.0:1788211881.319063:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788211881.319075:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+11:14434:x1875075660868864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788211881.319091:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211881.319111:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abff63c6a00/0x2afbce82f55a663a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6633 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211881.319139:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abff63c6a00/0x2afbce82f55a663a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6633 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211881.319151:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abff63c6a00/0x2afbce82f55a663a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6633 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211881.319162:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6a00, rc 0) 00000100:00100000:2.0:1788211881.319252:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14434:x1875075660868864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211881.319259:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788211881.319369:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660868864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211881.319388:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a663a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211881.319397:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a663a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211881.319622:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660868992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211881.319958:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211881.320004:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec6752840 going to sleep for 11 seconds 00000100:00100000:2.0:1788211881.320069:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660868992 00000100:00100000:2.0:1788211881.320076:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660868992 00000100:00100000:2.0:1788211881.320131:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788211881.320139:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14434:x1875075660868992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211881.320534:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14434:x1875075660868992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211881.320543:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788211881.320738:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660868992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211881.320785:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660869120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788211881.320906:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211881.320938:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec6752840 going to sleep for 11 seconds 00000100:00100000:2.0:1788211881.322842:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660869120 00000100:00100000:2.0:1788211881.322864:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660869120 00000100:00100000:2.0:1788211881.322957:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788211881.322970:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc5116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14434:x1875075660869120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211881.323318:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc5116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:14434:x1875075660869120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 351us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211881.323327:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788211881.323642:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660869120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788211881.331278:0:14938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788211881.331716:0:14434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788211881.331746:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788211881.331758:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a663a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211881.331770:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a663a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211881.509803:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211882.533379:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788211882.982843:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788211883.557502:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211884.582445:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788211885.285798:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788211885.285807:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788211885.285810:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788211885.285813:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788211885.285886:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660869376:0@lo:400:kworker.0 00000100:00100000:0.0:1788211885.285976:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211885.286033:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788211885.286039:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660869248:0@lo:400:kworker.0 00000100:00100000:0.0:1788211885.286068:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211885.286105:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660869248 00000100:00100000:0.0:1788211885.286113:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660869248 00000100:00100000:0.0:1788211885.286326:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788211885.286339:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc4b17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+12:3311:x1875075660869248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211885.286554:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc4b17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+12:3311:x1875075660869248:12345-0@lo:400:kworker.0 Request processed in 217us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211885.286573:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788211885.286625:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660869248:0@lo:400:kworker.0 00000100:00100000:1.0:1788211885.286701:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660869376 00000100:00100000:1.0:1788211885.286711:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660869376 00000100:00100000:1.0:1788211885.288050:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788211885.288064:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660869376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211885.288141:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660869376:12345-0@lo:400:kworker.0 Request processed in 81us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211885.288148:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788211885.288582:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ac001367480 x1875075660869376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211885.288597:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660869376:0@lo:400:kworker.0 00000020:01000004:3.0:1788211885.341733:0:15118:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788211885.341738:0:15118:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788211885.342094:0:15118:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8abec584a000 00000020:01000004:3.0:1788211885.342316:0:15118:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788211885.342329:0:15118:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788211885.342347:0:15118:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8abff7024d28) 00000020:00000080:3.0:1788211885.342365:0:15118:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788211885.369667:0:15118:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788211885.370815:0:15118:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788211885.372447:0:15118:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788211885.372691:0:15118:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788211885.373099:0:15118:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788211885.373520:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1788211885.373619:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1788211885.373765:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788211885.374531:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 676: rc = 0 00100000:10000000:0.0:1788211885.374782:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 676: rc = 0 00100000:10000000:0.0:1788211885.375287:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 676: rc = 0 00100000:10000000:0.0:1788211885.375553:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 676: rc = 0 00100000:10000000:0.0:1788211885.375800:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 676: rc = 0 00100000:10000000:0.0:1788211885.376333:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 676: rc = 0 00000020:00000080:0.0:1788211885.377209:0:15118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788211885.377226:0:15118:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788211885.377244:0:15118:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2afbce82f55a6648 00000020:01000004:0.0:1788211885.377257:0:15118:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788211885.377289:0:15118:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.129@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788211885.377303:0:15118:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788211885.377310:0:15118:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788211885.377316:0:15118:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788211885.377332:0:15118:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8abfd2a18000) 00000020:00000080:0.0:1788211885.377344:0:15118:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788211885.378883:0:15118:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788211885.379108:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788211885.379116:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788211885.382655:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788211885.382672:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788211885.383649:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788211885.383660:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788211885.388501:0:15118:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211885.388692:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788211885.388698:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788211885.390469:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788211885.390481:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788211885.424739:0:15118:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788211885.425031:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788211885.425038:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788211885.429595:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788211885.429612:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788211885.430811:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788211885.430825:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788211885.433540:0:15118:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788211885.433750:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788211885.433756:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788211885.434534:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788211885.434543:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788211885.475007:0:15118:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788211885.475296:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788211885.475305:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788211885.480518:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788211885.480534:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788211885.481103:0:15118:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788211885.481138:0:15118:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788211885.481144:0:15118:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788211885.495796:0:15118:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788211885.495852:0:15118:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.129@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788211885.495857:0:15118:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788211885.495859:0:15118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788211885.495861:0:15118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211885.495862:0:15118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211885.495864:0:15118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211885.495865:0:15118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211885.495867:0:15118:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788211885.495869:0:15118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211885.495871:0:15118:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788211885.495875:0:15118:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788211885.495877:0:15118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788211885.495883:0:15118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788211885.495884:0:15118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211885.495885:0:15118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211885.495886:0:15118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211885.495888:0:15118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211885.495889:0:15118:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788211885.495889:0:15118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211885.495890:0:15118:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788211885.495989:0:15118:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788211885.496017:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660869504:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788211885.496121:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211885.496225:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffbc3be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788211885.496342:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660869504 00000100:00100000:1.0:1788211885.496354:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660869504 00000100:00100000:1.0:1788211885.496407:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788211885.496418:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc4b16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+12:15118:x1875075660869504:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788211885.496454:0:14431:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788211885.496457:0:14431:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788211885.496461:0:14431:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788211885.518375:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc4b16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+12:15118:x1875075660869504:12345-0@lo:253:mount.lustre.0 Request processed in 21940us (22236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211885.518409:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788211885.519110:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660869504:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788211885.519131:0:15118:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788211885.519135:0:15118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788211885.519137:0:15118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788211885.519138:0:15118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211885.519139:0:15118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211885.519141:0:15118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211885.519142:0:15118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211885.519144:0:15118:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788211885.519146:0:15118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211885.519147:0:15118:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788211885.519462:0:15118:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8abec584a000 from lustre-OST0000 10000000:01000000:3.0:1788211885.519493:0:15118:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788211885.519496:0:15118:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788211885.519504:0:15118:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8abff7020000 local copy 00010000:00010000:3.0:1788211885.522527:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211885.522846:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660869632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788211885.522930:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211885.522984:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6f45180 going to sleep for 11 seconds 00000100:00100000:0.0:1788211885.523095:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660869632 00000100:00100000:0.0:1788211885.523105:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660869632 00000100:00100000:0.0:1788211885.523196:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788211885.523208:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc4b17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:15118:x1875075660869632:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788211885.523403:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc4b17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+12:15118:x1875075660869632:12345-0@lo:501:mount.lustre.0 Request processed in 197us (471us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788211885.523412:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788211885.523800:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660869632:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788211885.523821:0:15118:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788211885.524015:0:15118:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788211885.524024:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.524035:0:15118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211885.524065:0:15118:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8abec584a000 10000000:01000000:3.0:1788211885.524071:0:15118:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788211885.524077:0:15118:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8abff7020000 10000000:01000000:3.0:1788211885.524079:0:15118:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788211885.524084:0:15118:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8abff7020000 from 1 10000000:01000000:3.0:1788211885.524087:0:15118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788211885.524118:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063e00/0x2afbce82f55a6656 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.524134:0:15118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6063e00/0x2afbce82f55a6656 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.524145:0:15118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6063e00/0x2afbce82f55a6656 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211885.524162:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660869760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788211885.524245:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211885.524277:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6f45180 going to sleep for 11 seconds 00000100:00100000:2.0:1788211885.524540:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660869760 00000100:00100000:2.0:1788211885.524548:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660869760 00000100:00100000:2.0:1788211885.524586:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788211885.524612:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+12:15118:x1875075660869760:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788211885.524626:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211885.524645:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abff63c7200/0x2afbce82f55a665d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6656 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.524673:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abff63c7200/0x2afbce82f55a665d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6656 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.524699:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abff63c7200/0x2afbce82f55a665d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6656 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.524712:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c7200, rc 0) 00000100:00100000:2.0:1788211885.524765:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+13:15118:x1875075660869760:12345-0@lo:101:mount.lustre.0 Request processed in 156us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211885.524773:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788211885.525026:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660869760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788211885.525040:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6063e00/0x2afbce82f55a6656 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a665d expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.525050:0:15118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6063e00/0x2afbce82f55a6656 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a665d expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211885.525070:0:15118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788211885.525090:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063e00/0x2afbce82f55a6656 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a665d expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.525099:0:15118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6063e00/0x2afbce82f55a6656 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a665d expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211885.525108:0:15118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788211885.525112:0:15118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788211885.525117:0:15118:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788211885.525120:0:15118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788211885.525145:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.525153:0:15118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.525162:0:15118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211885.525202:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660869888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788211885.525231:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211885.525254:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6f45180 going to sleep for 11 seconds 00000100:00100000:0.0:1788211885.525522:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660869888 00000100:00100000:0.0:1788211885.525528:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660869888 00000100:00100000:0.0:1788211885.525560:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788211885.525568:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+13:15118:x1875075660869888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788211885.525578:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211885.525608:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfca8cce00/0x2afbce82f55a666b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6664 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211885.525627:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfca8cce00/0x2afbce82f55a666b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6664 expref: 14 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211885.525638:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfca8cce00/0x2afbce82f55a666b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6664 expref: 14 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211885.525654:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cce00, rc 0) 00000100:00100000:0.0:1788211885.525747:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+14:15118:x1875075660869888:12345-0@lo:101:mount.lustre.0 Request processed in 179us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211885.525754:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788211885.526272:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660869888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788211885.530578:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.530956:0:15118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788211885.533458:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788211885.538641:0:15118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788211885.539008:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788211885.539056:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788211885.539087:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788211885.539132:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788211885.539194:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788211885.539232:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788211885.539483:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788211885.539492:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788211885.539610:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788211885.539739:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211885.539885:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6f45240 going to sleep for 11 seconds 00000100:00100000:0.0:1788211885.540439:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660870016 00000100:00100000:0.0:1788211885.540450:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660870016 00000100:00100000:1.0:1788211885.540674:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788211885.540697:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+14:15118:x1875075660870016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211885.541862:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+14:15118:x1875075660870016:12345-0@lo:501:mount.lustre.0 Request processed in 1164us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211885.541885:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788211885.542076:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788211885.542128:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788211885.542444:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211885.542478:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6f45240 going to sleep for 11 seconds 00000100:00100000:1.0:1788211885.542532:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660870144 00000100:00100000:1.0:1788211885.542539:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660870144 00000100:00100000:1.0:1788211885.542674:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788211885.542684:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+14:15118:x1875075660870144:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211885.543268:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+14:15118:x1875075660870144:12345-0@lo:503:mount.lustre.0 Request processed in 582us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211885.543276:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788211885.543393:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870144:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788211885.544832:0:15118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788211885.545036:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788211885.545103:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211885.545629:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe477ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211885.545820:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660870272 00000100:00100000:2.0:1788211885.545828:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660870272 00000100:00100000:2.0:1788211885.545939:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788211885.545961:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+14:15118:x1875075660870272:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788211885.546262:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+14:15118:x1875075660870272:12345-0@lo:502:mount.lustre.0 Request processed in 304us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211885.546270:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788211885.546513:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788211885.552807:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788211885.552926:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788211885.552973:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788211885.553026:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788211885.553065:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788211885.553099:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788211885.553150:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788211885.553229:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788211885.553264:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788211885.555967:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788211885.556074:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788211885.556129:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788211885.558532:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788211885.558648:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211885.558778:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc305a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211885.561435:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660870400 00000100:00100000:2.0:1788211885.561455:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660870400 00000100:00100000:2.0:1788211885.561540:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788211885.561553:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+14:15118:x1875075660870400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788211885.561920:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+14:15118:x1875075660870400:12345-0@lo:502:mount.lustre.0 Request processed in 369us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211885.561929:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788211885.562538:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788211885.562709:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788211885.562729:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788211885.576332:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788211885.576345:0:15133:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788211885.576354:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211885.576368:0:15133:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788211885.576376:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788211885.576395:0:15133:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8abfca8bb370) 00000020:00000080:1.0:1788211885.576423:0:15133:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788211885.576428:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788211885.576499:0:15133:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abec584a000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788211885.576509:0:15133:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788211885.576519:0:15133:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2afbce82f55a6679 00010000:00010000:1.0:1788211885.581126:0:15133:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788211885.582127:0:15133:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788211885.585117:0:15133:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788211885.587614:0:15133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788211885.587631:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211885.587638:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211885.587640:0:15133:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788211885.587645:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788211885.587662:0:15133:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788211885.587665:0:15133:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788211885.587667:0:15133:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788211885.587669:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788211885.587672:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211885.587673:0:15133:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788211885.587676:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211885.587679:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211885.587680:0:15133:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788211885.587683:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788211885.587685:0:15133:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788211885.587688:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211885.587690:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211885.587692:0:15133:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788211885.587694:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211885.587697:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211885.587699:0:15133:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788211885.587703:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788211885.587783:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211885.587786:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211885.587787:0:15133:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788211885.587790:0:15133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788211885.587862:0:15118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788211885.587909:0:15118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788211885.587932:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.587954:0:15118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211885.587964:0:15118:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abec584a000 from 1 10000000:01000000:2.0:1788211885.587968:0:15118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788211885.588009:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.588029:0:15118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.588043:0:15118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211885.588069:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788211885.588149:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211885.588214:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc5beecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211885.588247:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660870528 00000100:00100000:2.0:1788211885.588254:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660870528 00000100:00100000:2.0:1788211885.588302:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788211885.588313:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+14:15118:x1875075660870528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788211885.588328:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211885.588343:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abff63c6c00/0x2afbce82f55a6687 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6680 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.588366:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abff63c6c00/0x2afbce82f55a6687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6680 expref: 15 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.588376:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abff63c6c00/0x2afbce82f55a6687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6680 expref: 15 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.588385:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abff63c6c00, rc 0) 00000100:00100000:2.0:1788211885.588427:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+15:15118:x1875075660870528:12345-0@lo:101:mount.lustre.0 Request processed in 115us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211885.588433:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788211885.588493:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788211885.588508:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6687 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.588516:0:15118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6687 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788211885.589035:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788211885.589441:0:15118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788211885.589691:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788211885.589734:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788211885.589791:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788211885.589799:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788211885.589869:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788211885.589928:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211885.598767:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffbc3be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788211885.604330:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660870656 00000100:00100000:3.0:1788211885.604589:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660870656 00000100:00100000:2.0:1788211885.604745:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788211885.604759:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+15:15118:x1875075660870656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788211885.605129:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+15:15118:x1875075660870656:12345-0@lo:501:mount.lustre.0 Request processed in 371us (15198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211885.605137:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788211885.605307:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788211885.606662:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788211885.606782:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211885.606841:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffbc3be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211885.606874:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660870784 00000100:00100000:2.0:1788211885.606883:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660870784 00000100:00100000:2.0:1788211885.606937:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788211885.606956:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+15:15118:x1875075660870784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788211885.609572:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+15:15118:x1875075660870784:12345-0@lo:503:mount.lustre.0 Request processed in 2606us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211885.609591:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788211885.611981:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870784:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788211885.612874:0:15118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788211885.613008:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788211885.613122:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211885.613197:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6f45780 going to sleep for 11 seconds 00010000:00010000:0.0:1788211885.614038:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211885.620911:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660870912 00000100:00100000:2.0:1788211885.620931:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660870912 00000100:00100000:2.0:1788211885.621014:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788211885.621027:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef994850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+15:15118:x1875075660870912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788211885.621369:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef994850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+15:15118:x1875075660870912:12345-0@lo:502:mount.lustre.0 Request processed in 333us (8235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211885.621378:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788211885.621446:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660870912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788211885.621764:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788211885.621823:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788211885.621872:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788211885.621910:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788211885.621957:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788211885.622034:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788211885.622073:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788211885.622122:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788211885.622187:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660871040:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788211885.622236:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211885.622270:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc776ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788211885.622292:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660871040 00000100:00100000:2.0:1788211885.622298:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660871040 00000100:00100000:2.0:1788211885.622336:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788211885.622344:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+15:15118:x1875075660871040:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788211885.622500:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+15:15118:x1875075660871040:12345-0@lo:502:mount.lustre.0 Request processed in 155us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211885.622508:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788211885.622556:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660871040:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788211885.622642:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788211885.622652:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788211885.626531:0:15137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211885.626550:0:15137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211885.626552:0:15137:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788211885.626560:0:15137:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abec584a000 00000020:00000080:0.0:1788211885.626563:0:15137:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788211885.626572:0:15137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211885.626575:0:15137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211885.626576:0:15137:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788211885.626578:0:15137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211885.626580:0:15137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211885.626582:0:15137:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788211885.626585:0:15137:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abec584a000 00000020:00000080:0.0:1788211885.626587:0:15137:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788211885.626663:0:15137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211885.628535:0:15137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211885.628543:0:15137:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788211885.628555:0:15137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211885.628561:0:15137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211885.628563:0:15137:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788211885.628569:0:15137:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8abec584a000 00000020:00000080:0.0:1788211885.628571:0:15137:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788211885.640797:0:15137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211885.640812:0:15137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211885.640815:0:15137:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788211885.640821:0:15137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788211885.641005:0:15118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788211885.641031:0:15118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788211885.641055:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6687 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.641067:0:15118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6687 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211885.641126:0:15118:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788211885.641130:0:15118:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8abec584a000 10000000:01000000:3.0:1788211885.641133:0:15118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8abec584a000 10000000:01000000:3.0:1788211885.641137:0:15118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788211885.641142:0:15118:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8abec584a000 from 1 10000000:01000000:3.0:1788211885.641145:0:15118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788211885.641651:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.641662:0:15118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.641674:0:15118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211885.641699:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660871168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788211885.641771:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211885.641809:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6f45180 going to sleep for 11 seconds 00000100:00100000:3.0:1788211885.642328:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660871168 00000100:00100000:3.0:1788211885.642338:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660871168 00000100:00100000:3.0:1788211885.642459:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788211885.642471:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+15:15118:x1875075660871168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788211885.642489:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211885.642505:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6062800/0x2afbce82f55a6695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a668e expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.642530:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6062800/0x2afbce82f55a6695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a668e expref: 16 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.642541:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6062800/0x2afbce82f55a6695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a668e expref: 16 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.642550:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062800, rc 0) 00000100:00100000:3.0:1788211885.642619:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15118:x1875075660871168:12345-0@lo:101:mount.lustre.0 Request processed in 150us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211885.642625:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788211885.642746:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660871168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788211885.642763:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.642774:0:15118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788211885.643667:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788211885.644043:0:15118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788211885.650931:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788211885.651042:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788211885.651076:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788211885.651118:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788211885.651151:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788211885.651754:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788211885.651794:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788211885.651845:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788211885.651903:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788211885.651939:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788211885.651989:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788211885.652034:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788211885.652066:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788211885.652097:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788211885.652138:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788211885.654535:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788211885.654748:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788211885.654823:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788211885.655495:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788211885.655533:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788211885.655586:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788211885.655928:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788211885.662292:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788211885.662716:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788211885.662760:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788211885.662792:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788211885.662840:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788211885.662874:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788211885.663522:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788211885.663535:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788211885.664088:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660871296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211885.664245:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211885.664295:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9ca540 going to sleep for 11 seconds 00000100:00100000:1.0:1788211885.665477:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660871296 00000100:00100000:1.0:1788211885.665488:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660871296 00000100:00100000:1.0:1788211885.665540:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788211885.665551:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15118:x1875075660871296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211885.666568:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15118:x1875075660871296:12345-0@lo:501:mount.lustre.0 Request processed in 1013us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211885.666578:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788211885.675785:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660871296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788211885.675878:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660871424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788211885.676001:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211885.676056:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9ca540 going to sleep for 11 seconds 00000100:00100000:3.0:1788211885.676080:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660871424 00000100:00100000:3.0:1788211885.676086:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660871424 00000100:00100000:3.0:1788211885.676133:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788211885.676143:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15118:x1875075660871424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788211885.676395:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15118:x1875075660871424:12345-0@lo:503:mount.lustre.0 Request processed in 252us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211885.676404:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788211885.676454:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660871424:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788211885.677157:0:15118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788211885.677285:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660871552:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788211885.677333:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211885.677351:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffbc3be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788211885.679005:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660871552 00000100:00100000:1.0:1788211885.679036:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660871552 00000100:00100000:1.0:1788211885.679111:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788211885.679122:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15118:x1875075660871552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788211885.679672:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15118:x1875075660871552:12345-0@lo:502:mount.lustre.0 Request processed in 549us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211885.679682:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788211885.690776:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660871552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788211885.691149:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788211885.691254:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788211885.691293:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788211885.691356:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788211885.691393:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788211885.691437:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788211885.691470:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788211885.691500:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788211885.691543:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788211885.691575:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788211885.691620:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788211885.691668:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788211885.691702:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788211885.691749:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788211885.691799:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788211885.691835:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788211885.691869:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788211885.691917:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788211885.691964:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788211885.691998:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788211885.692045:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788211885.692077:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788211885.692107:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788211885.692152:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788211885.692218:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788211885.692254:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788211885.692301:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788211885.692337:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788211885.692370:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788211885.692436:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788211885.692472:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788211885.692504:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788211885.692534:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788211885.692577:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788211885.692611:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788211885.692657:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788211885.692694:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788211885.692729:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788211885.692772:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788211885.692806:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788211885.692867:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660871680:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788211885.692966:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211885.693022:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9ca540 going to sleep for 11 seconds 00000100:00100000:3.0:1788211885.693054:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660871680 00000100:00100000:3.0:1788211885.693062:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660871680 00000100:00100000:3.0:1788211885.693115:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788211885.693124:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15118:x1875075660871680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788211885.693370:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15118:x1875075660871680:12345-0@lo:502:mount.lustre.0 Request processed in 246us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211885.693379:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788211885.698897:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660871680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788211885.701565:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788211885.701589:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788211885.706938:0:15142:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788211885.706967:0:15142:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8abfca8bcd28) 00000020:00000080:1.0:1788211885.707318:0:15142:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788211885.707425:0:15142:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abec584a000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788211885.707434:0:15142:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8abec584a000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788211885.707436:0:15142:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abec584a000 3 00010000:00080000:1.0:1788211885.707470:0:15142:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abec53e4000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.129@tcp at head 00010000:00010000:1.0:1788211885.715608:0:15142:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788211885.715836:0:15142:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788211885.715877:0:15142:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788211885.715892:0:15142:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2afbce82f55a66a3 00000100:00080000:1.0:1788211885.715903:0:15142:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788211885.715911:0:15142:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8abec53e4000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211885.717389:0:15142:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001366680 x1875075660871808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788211885.717420:0:15142:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788211885.717483:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788211885.717488:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788211885.717492:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788211885.717495:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788211885.717532:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660871936:0@lo:400:kworker.0 00000100:00100000:1.0:1788211885.717692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211885.717742:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211885.717748:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660872064:0@lo:400:kworker.0 00000100:00100000:1.0:1788211885.717774:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211885.718072:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660871936 00000100:00100000:1.0:1788211885.718082:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660871936 00000100:00100000:1.0:1788211885.718129:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788211885.718138:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+16:3308:x1875075660871936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211885.718440:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875075660871808:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788211885.718478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211885.718516:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+16:3308:x1875075660871936:12345-0@lo:400:kworker.0 Request processed in 378us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211885.718533:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788211885.724605:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660872064 00000100:00100000:1.0:1788211885.724621:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660872064 00000100:00100000:1.0:1788211885.724680:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660871808 00000100:00100000:1.0:1788211885.724685:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660871808 00000100:00100000:1.0:1788211885.724704:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788211885.724716:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660872064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211885.724814:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660872064:12345-0@lo:400:kworker.0 Request processed in 100us (7038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211885.724823:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788211885.724846:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788211885.724850:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875075660871808:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788211885.724881:0:14438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:1.0:1788211885.724927:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2afbce82f55a66aa 00000004:00100000:1.0:1788211885.724960:0:14438:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788211885.725021:0:14438:0:(import.c:65:import_set_state_nolock()) ffff8abfcaf35800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788211885.725072:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875075660871808:12345-0@lo:38:llog_process_th.0 Request processed in 220us (6594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211885.725079:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788211885.725133:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001365180 x1875075660872064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211885.725148:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660872064:0@lo:400:kworker.0 00000100:00100000:1.0:1788211885.725192:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660871936:0@lo:400:kworker.0 00010000:00080000:1.0:1788211885.725365:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001366680 x1875075660871808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788211895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211885.725394:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788211885.725403:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788211885.725412:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788211885.725418:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788211885.725420:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec53e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788211885.725426:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875075660871808:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788211885.725991:0:15142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788211885.726047:0:15118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788211885.726075:0:15118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788211885.726091:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211885.726102:0:15118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788211885.726150:0:15118:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788211885.726152:0:15118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788211885.726154:0:15118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211885.726155:0:15118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211885.726156:0:15118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211885.726158:0:15118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211885.726160:0:15118:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788211885.726161:0:15118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211885.726185:0:15118:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788211885.726189:0:15118:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788211885.726192:0:15118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788211885.726198:0:15118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788211885.726199:0:15118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211885.726200:0:15118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211885.726201:0:15118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211885.726202:0:15118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211885.726203:0:15118:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788211885.726204:0:15118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211885.726205:0:15118:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788211885.726388:0:15118:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788211885.726406:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660872192:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788211885.726465:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211885.726500:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec10b8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788211885.726520:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660872192 00000100:00100000:3.0:1788211885.726527:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660872192 00000100:00100000:3.0:1788211885.726564:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788211885.726572:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15118:x1875075660872192:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788211885.726600:0:14432:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788211885.726617:0:14432:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788211885.793654:0:14432:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788211885.793679:0:14432:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788211885.793896:0:14453:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788211885.793902:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788211885.793950:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211885.794005:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a661e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6617 expref: 16 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211885.794014:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211885.794337:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a661e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a6617 expref: 16 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211885.794356:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a661e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a6617 expref: 16 pid: 14432 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211885.794373:0:14453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1875075660872320:0@lo:104: 00000100:00100000:0.0:1788211885.794465:0:14453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211885.794520:0:14453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc886a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211885.794553:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660872320 00000100:00100000:0.0:1788211885.794561:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660872320 00000100:00100000:0.0:1788211885.795394:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788211885.795410:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05b7e8c1-59a4-46a9-9396-986dc762646c+3:14453:x1875075660872320:12345-0@lo:104: 00010000:00010000:0.0:1788211885.795428:0:14421:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a661e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211885.795530:0:14421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788211885.795538:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05b7e8c1-59a4-46a9-9396-986dc762646c+3:14453:x1875075660872320:12345-0@lo:104: Request processed in 131us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211885.795548:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788211885.795576:0:14453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1875075660872320:0@lo:104: 00010000:00010000:1.0:1788211885.795602:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.795613:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211885.795625:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a661e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.795665:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:2.0:1788211885.795672:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a661e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.795682:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a661e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211885.795691:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a661e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211885.795699:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788211885.795743:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a661e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.795752:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788211885.795775:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a661e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.795805:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a6617 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a661e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211885.795825:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211885.795828:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211885.795830:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211885.795860:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660872448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788211885.795904:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211885.796119:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660872448 00000100:00100000:1.0:1788211885.796126:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660872448 00010000:00010000:1.0:1788211885.796156:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a661e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6617 expref: 17 pid: 14432 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211885.796205:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788211885.796214:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05b7e8c1-59a4-46a9-9396-986dc762646c+17:3310:x1875075660872448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788211885.796227:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211885.796234:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a661e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6617 expref: 17 pid: 14432 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796245:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a661e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a6617 expref: 17 pid: 14432 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796264:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a661e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a6617 expref: 17 pid: 14432 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796298:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796307:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788211885.796325:0:14424:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002423572s 00010000:00010000:1.0:1788211885.796330:0:14424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796337:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796345:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796351:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796364:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788211885.796368:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796375:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796390:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796399:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211885.796445:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05b7e8c1-59a4-46a9-9396-986dc762646c+16:3310:x1875075660872448:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211885.796452:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788211885.796473:0:14453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796481:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211885.796487:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfca8cc600/0x2afbce82f55a66b1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211885.797315:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660872448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211885.813285:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+15:15118:x1875075660872192:12345-0@lo:253:mount.lustre.0 Request processed in 86703us (86809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211885.813323:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788211885.813540:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15118:1875075660872192:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788211885.813557:0:15118:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788211885.813560:0:15118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788211885.813562:0:15118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788211885.813564:0:15118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211885.813565:0:15118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211885.813566:0:15118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211885.813567:0:15118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211885.813569:0:15118:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788211885.813571:0:15118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211885.813572:0:15118:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788211885.813586:0:15118:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788211885.819234:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211885.819736:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788211885.820113:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211885.820578:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788211885.820739:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211885.821242:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788211885.822517:0:15118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788211885.881595:0:15118:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788211885.881603:0:15118:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788211885.881643:0:15118:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788211885.881710:0:15118:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788211885.881724:0:15118:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788211885.881751:0:15118:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788211886.629383:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788211887.141488:0:14434:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788211887.141500:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ac00108a000 from 7 10000000:01000000:2.0:1788211887.141579:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788211887.141631:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211887.141654:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211887.141665:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211887.141695:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef634000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660872576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788211887.141992:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211887.142106:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc776e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211887.145509:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660872576 00000100:00100000:1.0:1788211887.145525:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660872576 00000100:00100000:1.0:1788211887.145600:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788211887.145613:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+15:14434:x1875075660872576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211887.145633:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211887.145671:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a66bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a66b8 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211887.145716:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a66bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a66b8 expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211887.145731:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a66bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a66b8 expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211887.145755:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37a600, rc 0) 00000100:00100000:1.0:1788211887.147038:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+16:14434:x1875075660872576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1422us (5041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211887.147050:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788211887.147131:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef634000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660872576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211887.147155:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a66bf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211887.147181:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a66bf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211887.147272:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660872704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788211887.147323:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211887.147361:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec676d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211887.147560:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660872704 00000100:00100000:0.0:1788211887.147568:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660872704 00000100:00100000:0.0:1788211887.147612:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788211887.147622:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+16:14434:x1875075660872704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788211887.147644:0:14431:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788211887.147662:0:14431:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788211887.147665:0:14431:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788211887.147766:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+16:14434:x1875075660872704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211887.147772:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788211887.148041:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660872704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788211887.148106:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788211887.148116:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a66bf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211887.148139:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a66bf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211887.662667:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211888.680444:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211889.702272:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211890.726362:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788211890.918604:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788211890.918612:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788211890.918615:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788211890.918618:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788211890.918671:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660872832:0@lo:400:kworker.0 00000100:00100000:0.0:1788211890.918769:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211890.918871:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660872832 00000100:00100000:0.0:1788211890.918878:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660872832 00000100:00100000:0.0:1788211890.918928:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788211890.918939:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef995c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+16:3311:x1875075660872832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211890.918999:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef995c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+16:3311:x1875075660872832:12345-0@lo:400:kworker.0 Request processed in 62us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211890.919028:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788211890.919213:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660872960:0@lo:400:kworker.0 00000100:00100000:1.0:1788211890.919258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211890.919281:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211890.919286:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660873088:0@lo:400:kworker.0 00000100:00100000:1.0:1788211890.919305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211890.919350:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660872960 00000100:00100000:1.0:1788211890.919354:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660872960 00000100:00100000:1.0:1788211890.919380:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660873088 00000100:00100000:1.0:1788211890.919383:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660873088 00000100:00100000:1.0:1788211890.919410:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788211890.919415:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660872960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211890.919453:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660872960:12345-0@lo:400:kworker.0 Request processed in 37us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211890.919460:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788211890.919474:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788211890.919480:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660873088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211890.919506:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660873088:12345-0@lo:400:kworker.0 Request processed in 27us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211890.919512:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788211890.919547:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788211890.920006:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfca87b800 x1875075660873088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211890.920022:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660873088:0@lo:400:kworker.0 00010000:00080000:1.0:1788211890.920034:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfca87a680 x1875075660872960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211890.920043:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660872960:0@lo:400:kworker.0 00000100:00100000:0.0:1788211890.920216:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660872832:0@lo:400:kworker.0 00010000:00010000:0.0:1788211891.749875:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788211892.197798:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788211892.774875:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788211892.974101:0:15488:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788211893.798123:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211894.829485:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211895.849762:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211895.976599:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788211880/real 1788211880] req@ffff8ac001364700 x1875075660868480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788211895 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211895.976647:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac001364700 x1875075660868480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788211895 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211895.976659:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788211880/real 1788211880] req@ffff8ac001365880 x1875075660868608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788211895 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211895.976672:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac001365880 x1875075660868608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788211895 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788211895.976692:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abff600f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788211895.976715:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788211895.976720:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660868480:0@lo:8:kworker.0 00000100:00080000:2.0:1788211895.976726:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfe472f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788211895.976732:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788211895.976735:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660868608:0@lo:8:kworker.0 00000100:00100000:3.0:1788211895.977102:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1788211895.978328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788211895.978336:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788211895.978342:0:36:0:(import.c:65:import_set_state_nolock()) ffff8abff600f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788211895.978353:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:1.0:1788211895.978372:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788211895.978382:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8abff600f800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211895.978425:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001366300 x1875075660873344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788211895.978452:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788211895.978456:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788211895.978458:0:36:0:(import.c:65:import_set_state_nolock()) ffff8abfe472f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788211895.978462:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:1.0:1788211895.978465:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788211895.978468:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8abfe472f000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211895.978484:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001365880 x1875075660873472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788211895.978512:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660873344:0@lo:8:kworker.0 00000100:00100000:2.0:1788211895.978648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211895.978795:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660873472:0@lo:8:kworker.0 00000100:00100000:2.0:1788211895.978844:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211895.979283:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660873344 00000100:00100000:3.0:1788211895.979477:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660873600:0@lo:400:kworker.0 00000100:00100000:3.0:1788211895.979531:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211895.979567:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660873216:0@lo:400:kworker.0 00000100:00100000:3.0:1788211895.979601:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211895.979664:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660873600 00000100:00100000:2.0:1788211895.979677:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660873600 00000100:00100000:2.0:1788211895.979802:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788211895.979821:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660873600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211895.979922:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660873600:12345-0@lo:400:kworker.0 Request processed in 105us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211895.979936:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788211895.980047:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001364700 x1875075660873600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788211895.980061:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660873600:0@lo:400:kworker.0 00000100:00100000:0.0:1788211895.980247:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660873344 00000100:00100000:0.0:1788211895.980283:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660873472 00000100:00100000:0.0:1788211895.980286:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660873472 00000100:00100000:3.0:1788211895.980333:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788211895.980341:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875075660873344:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788211895.980459:0:15121:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:3.0:1788211895.980501:0:15121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a66c6 00002000:00100000:3.0:1788211895.980519:0:15121:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8abec5842000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788211895.980524:0:15121:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788211895.980527:0:15121:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788211895.980797:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788211895.980815:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788211895.981064:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660873216 00000100:00100000:1.0:1788211895.981069:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660873216 00000100:00100000:1.0:1788211895.981271:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788211895.981281:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+16:3311:x1875075660873216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211895.981355:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+16:3311:x1875075660873216:12345-0@lo:400:kworker.0 Request processed in 77us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211895.981362:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00002000:00080000:3.0:1788211895.981814:0:15121:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788211895.981978:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660873728:0@lo:400:kworker.0 00000100:00100000:1.0:1788211895.982019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211895.982063:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660873728 00000100:00100000:2.0:1788211895.982071:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660873728 00000100:00100000:2.0:1788211895.982117:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788211895.982126:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660873728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211895.982198:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660873728:12345-0@lo:400:kworker.0 Request processed in 73us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211895.982204:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788211895.982270:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660873216:0@lo:400:kworker.0 00000100:00080000:1.0:1788211895.982293:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788211895.982317:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001364a80 x1875075660873728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211895.982330:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660873728:0@lo:400:kworker.0 00000100:00080000:3.0:1788211895.982475:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8abec5841800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788211895.982537:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875075660873344:12345-0@lo:8:kworker.0 Request processed in 2193us (3889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211895.982546:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788211895.982566:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788211895.982570:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875075660873472:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788211895.982594:0:15121:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788211895.982624:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875075660873472:12345-0@lo:8:kworker.0 Request processed in 53us (3781us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788211895.982631:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788211895.983051:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfe472f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788211895.983058:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788211895.983061:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660873472:0@lo:8:kworker.0 00010000:00080000:0.0:1788211895.983074:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001366300 x1875075660873344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788211915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211895.983083:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788211895.983296:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788211895.983307:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788211895.983313:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788211895.983315:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abff600f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788211895.983377:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788211895.983384:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660873344:0@lo:8:kworker.0 00000100:00100000:0.0:1788211895.983480:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660873856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211895.983522:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788211895.983586:0:14460:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788211895.983602:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660873856 00000100:00100000:3.0:1788211895.983609:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660873856 00000100:00100000:2.0:1788211895.983611:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef634e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1875075660873984:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788211895.983645:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211895.983653:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788211895.983663:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875075660873856:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788211895.983666:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc76c76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211895.983691:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660873984 00002000:00000024:3.0:1788211895.983695:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211895.983708:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660873984 00000100:00100000:2.0:1788211895.983739:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788211895.983761:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14460:x1875075660873984:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788211895.983770:0:14459:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788211895.984348:0:14459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 485290180026ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788211895.987399:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875075660873856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3729us (3867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211895.987418:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788211895.987466:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788211895.989960:0:15120:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788211895.990107:0:15120:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788211895.990116:0:15120:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00010000:00080000:0.0:1788211895.993548:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfef637b80 x1875075660873856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788211895.997596:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660873856:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1788211896.012915:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.012929:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a66cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.012950:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.012956:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.012963:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a66cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.012998:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a66cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.013011:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a66cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.013019:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a66cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.013041:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211896.013059:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.013066:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a66cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.013074:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.013080:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a66cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.013091:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a66cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.013121:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a66cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.013129:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a66cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.015328:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.015340:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.015345:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211896.016938:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211896.016958:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a66d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.016978:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1788211896.016983:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211896.016989:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a66d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.017007:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a66d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.017019:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a66d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.017040:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a66d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.017065:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211896.017082:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211896.017089:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a66d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.017098:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.017114:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a66d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.017124:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a66d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.017143:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a66d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.017153:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a66d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788211896.026611:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.026625:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a75d61a3/0x2afbce82f55a66db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.026644:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.026649:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.026655:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a75d61a3/0x2afbce82f55a66db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.026670:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a75d61a3/0x2afbce82f55a66db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.026680:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a75d61a3/0x2afbce82f55a66db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.026689:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a75d61a3/0x2afbce82f55a66db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.026708:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788211896.027060:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1788211896.029221:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.029569:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cabfd05c/0x2afbce82f55a66e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.029605:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.029610:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.029617:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cabfd05c/0x2afbce82f55a66e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.029633:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cabfd05c/0x2afbce82f55a66e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.029647:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cabfd05c/0x2afbce82f55a66e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.029655:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cabfd05c/0x2afbce82f55a66e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.029669:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788211896.030223:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.030229:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000479a874f/0x2afbce82f55a66e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.030253:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.030257:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.030261:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000479a874f/0x2afbce82f55a66e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.030272:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000479a874f/0x2afbce82f55a66e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.030291:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000479a874f/0x2afbce82f55a66e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.030298:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000479a874f/0x2afbce82f55a66e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.030309:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788211896.030993:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.031001:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a66f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.031011:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.031015:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.031019:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a66f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.031030:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a66f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.031038:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a66f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.031045:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a66f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.031065:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788211896.031735:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.031754:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e89cf17d/0x2afbce82f55a66f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.031764:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.031767:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.031771:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e89cf17d/0x2afbce82f55a66f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.031781:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e89cf17d/0x2afbce82f55a66f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.031788:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e89cf17d/0x2afbce82f55a66f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.031795:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e89cf17d/0x2afbce82f55a66f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.031804:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788211896.032735:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.032762:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044f17cc8/0x2afbce82f55a66fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.032777:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.032789:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.032796:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044f17cc8/0x2afbce82f55a66fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.032811:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044f17cc8/0x2afbce82f55a66fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.032820:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044f17cc8/0x2afbce82f55a66fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.032828:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044f17cc8/0x2afbce82f55a66fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.032839:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788211896.033866:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788211896.033874:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cabfd05c/0x2afbce82f55a66e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.033896:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.033903:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cabfd05c/0x2afbce82f55a66e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.033914:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cabfd05c/0x2afbce82f55a66e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.033941:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cabfd05c/0x2afbce82f55a66e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.033949:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cabfd05c/0x2afbce82f55a66e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.033965:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788211896.033970:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000479a874f/0x2afbce82f55a66e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.033977:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.033981:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000479a874f/0x2afbce82f55a66e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.033989:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000479a874f/0x2afbce82f55a66e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.033999:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000479a874f/0x2afbce82f55a66e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034012:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000479a874f/0x2afbce82f55a66e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034026:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788211896.034030:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a66f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034037:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.034040:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a66f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034048:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a66f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034059:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a66f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034067:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c16ff451/0x2afbce82f55a66f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034079:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788211896.034083:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e89cf17d/0x2afbce82f55a66f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034089:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.034097:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e89cf17d/0x2afbce82f55a66f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034105:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e89cf17d/0x2afbce82f55a66f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034115:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e89cf17d/0x2afbce82f55a66f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034122:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e89cf17d/0x2afbce82f55a66f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034133:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211896.034137:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044f17cc8/0x2afbce82f55a66fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034142:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.034145:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044f17cc8/0x2afbce82f55a66fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034153:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044f17cc8/0x2afbce82f55a66fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034161:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044f17cc8/0x2afbce82f55a66fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034195:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044f17cc8/0x2afbce82f55a66fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.034212:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.034214:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.034217:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.034766:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.034776:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a6705 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.034790:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.034794:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.034800:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a6705 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.034813:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a6705 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.034823:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a6705 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.034838:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a6705 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.034859:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211896.034871:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.034875:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a6705 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.034882:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.034886:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a6705 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.034895:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a6705 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.034909:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a6705 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.034916:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae116b98/0x2afbce82f55a6705 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.034930:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.034933:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.034934:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.035562:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.035570:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a75d61a3/0x2afbce82f55a66db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.035579:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.035583:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a75d61a3/0x2afbce82f55a66db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.035592:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a75d61a3/0x2afbce82f55a66db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.035604:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a75d61a3/0x2afbce82f55a66db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.035610:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a75d61a3/0x2afbce82f55a66db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.035627:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.035628:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.035630:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.035633:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.035635:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.036548:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.036564:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a670c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.036578:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.036582:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.036587:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a670c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.036599:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a670c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.036607:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a670c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.036615:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a670c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.036633:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211896.036644:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.036649:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a670c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.036655:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.036660:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a670c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.036667:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a670c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.036683:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a670c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.036691:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002466046f/0x2afbce82f55a670c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.036704:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.036705:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.036707:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.037486:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.037494:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a6713 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.037504:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.037507:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.037513:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a6713 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.037524:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a6713 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.037533:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a6713 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.037541:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a6713 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.037570:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211896.037581:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.037586:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a6713 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.037594:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.037597:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a6713 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.037605:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a6713 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.037617:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a6713 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.037624:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ca2d14/0x2afbce82f55a6713 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.037637:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.037639:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.037640:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.038071:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.038078:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a671a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.038087:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.038095:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.038100:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a671a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.038109:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a671a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.038117:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a671a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.038125:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a671a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.038142:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788211896.038958:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.038966:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a6721 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.038978:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.038982:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.038986:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a6721 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.038998:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a6721 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039007:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a6721 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039024:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a6721 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039047:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788211896.039071:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788211896.039078:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a671a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039085:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.039090:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a671a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039101:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a671a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039115:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a671a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039123:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a671a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039143:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.039147:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a6721 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039195:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.039199:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a6721 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039208:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a6721 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039220:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a6721 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039226:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a6721 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.039525:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.039527:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.039529:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.039537:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.046820:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.046836:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6728 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.046858:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.046863:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.046869:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6728 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.046898:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6728 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.046910:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6728 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.046919:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6728 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.046943:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211896.046961:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.046967:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6728 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.046976:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.046982:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6728 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.046993:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6728 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.047013:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6728 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.047020:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6728 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.047050:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.047052:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.047054:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211896.064253:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211896.064278:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a672f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.064299:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1788211896.064304:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211896.064311:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a672f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.064327:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a672f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.064339:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a672f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.064348:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a672f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.064372:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211896.068279:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.068297:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a672f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.068312:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.068318:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a672f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.068330:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a672f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.068353:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a672f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.068361:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a672f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.068386:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.068388:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.068390:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.070696:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.070719:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6736 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.070775:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.070780:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.070788:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.070805:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.070816:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.070824:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6736 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.070859:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788211896.071040:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788211896.071573:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211896.071583:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6736 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.071595:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.071601:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6736 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.071611:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6736 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.071640:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6736 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.071649:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec6719c4/0x2afbce82f55a6736 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.071672:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.071675:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.071677:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.071813:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.071821:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a673d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.071832:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.071836:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.071841:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a673d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.071852:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a673d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.071869:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a673d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.071877:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a673d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.071900:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211896.072344:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211896.072351:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a673d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.072359:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.072434:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a673d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.072443:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a673d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.072457:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a673d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.072465:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a49987a9/0x2afbce82f55a673d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.072496:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.072498:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.072500:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.073044:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.073052:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a6744 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.073063:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.073067:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.073073:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a6744 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.073103:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a6744 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.073113:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a6744 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.073121:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a6744 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.073330:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211896.073337:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a6744 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.073337:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788211896.073345:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.073349:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a6744 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.073358:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a6744 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.073450:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a6744 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.073457:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000660cf83/0x2afbce82f55a6744 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.073471:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.073473:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.073475:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.073804:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.073809:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049b8e251/0x2afbce82f55a674b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.073819:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.073822:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.073826:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049b8e251/0x2afbce82f55a674b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.073835:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049b8e251/0x2afbce82f55a674b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.073843:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049b8e251/0x2afbce82f55a674b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.073849:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049b8e251/0x2afbce82f55a674b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.073868:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211896.073944:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211896.073949:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049b8e251/0x2afbce82f55a674b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.073969:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.073973:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049b8e251/0x2afbce82f55a674b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.073981:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049b8e251/0x2afbce82f55a674b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.073992:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049b8e251/0x2afbce82f55a674b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.074000:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049b8e251/0x2afbce82f55a674b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.074014:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.074016:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.074018:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.075658:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.075674:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6752 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.075691:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.075705:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.075712:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6752 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.075729:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6752 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.075754:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6752 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.075762:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6752 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.075786:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211896.075801:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.075807:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6752 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.075814:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.075819:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6752 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.075827:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6752 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.075841:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6752 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.075859:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6752 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.075876:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.075877:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.075879:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.079648:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.079660:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de5f503/0x2afbce82f55a6759 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.079933:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.079939:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.079947:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009de5f503/0x2afbce82f55a6759 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.079963:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009de5f503/0x2afbce82f55a6759 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.079974:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de5f503/0x2afbce82f55a6759 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.079982:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009de5f503/0x2afbce82f55a6759 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.080004:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211896.080019:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.080039:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009de5f503/0x2afbce82f55a6759 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.080048:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.080053:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009de5f503/0x2afbce82f55a6759 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.080063:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009de5f503/0x2afbce82f55a6759 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.080095:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009de5f503/0x2afbce82f55a6759 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.080104:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009de5f503/0x2afbce82f55a6759 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.080419:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.080421:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.080423:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.082063:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.082075:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa4de7b7/0x2afbce82f55a6760 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.082955:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.082960:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.082966:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4de7b7/0x2afbce82f55a6760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.083000:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa4de7b7/0x2afbce82f55a6760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.083011:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa4de7b7/0x2afbce82f55a6760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.083019:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4de7b7/0x2afbce82f55a6760 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.083036:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211896.083224:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211896.083233:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa4de7b7/0x2afbce82f55a6760 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.083253:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.083258:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa4de7b7/0x2afbce82f55a6760 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.083267:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa4de7b7/0x2afbce82f55a6760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.083294:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa4de7b7/0x2afbce82f55a6760 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.083301:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa4de7b7/0x2afbce82f55a6760 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.083321:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.083323:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.083325:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.088610:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.088624:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6767 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.088642:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.088647:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.088653:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6767 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.088666:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6767 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.088691:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6767 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.088712:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6767 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.088729:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211896.088753:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.088760:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6767 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.088767:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.088773:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6767 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.088782:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6767 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.088800:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6767 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.088808:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6767 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.088824:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.088826:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.088828:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.089308:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.089322:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008459f803/0x2afbce82f55a676e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089331:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.089335:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.089340:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008459f803/0x2afbce82f55a676e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089350:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008459f803/0x2afbce82f55a676e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089359:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008459f803/0x2afbce82f55a676e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089366:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008459f803/0x2afbce82f55a676e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089380:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211896.089390:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.089394:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008459f803/0x2afbce82f55a676e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089401:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.089405:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008459f803/0x2afbce82f55a676e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089413:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008459f803/0x2afbce82f55a676e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089431:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008459f803/0x2afbce82f55a676e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089438:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008459f803/0x2afbce82f55a676e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089451:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.089453:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.089454:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.089807:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.089813:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6775 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089822:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.089825:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.089829:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6775 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089840:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6775 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089847:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6775 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089854:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6775 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.089879:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788211896.090262:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.090268:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be3550e5/0x2afbce82f55a677c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090276:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.090279:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.090283:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be3550e5/0x2afbce82f55a677c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090291:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be3550e5/0x2afbce82f55a677c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090299:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be3550e5/0x2afbce82f55a677c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090307:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be3550e5/0x2afbce82f55a677c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090319:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788211896.090329:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788211896.090333:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6775 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090340:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.090349:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6775 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090357:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6775 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090370:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6775 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090376:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6775 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090389:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.090392:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be3550e5/0x2afbce82f55a677c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090398:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.090402:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be3550e5/0x2afbce82f55a677c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090409:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be3550e5/0x2afbce82f55a677c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090419:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be3550e5/0x2afbce82f55a677c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090425:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be3550e5/0x2afbce82f55a677c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.090446:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.090448:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.090450:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.092634:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.094337:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.094353:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6783 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.094371:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.094375:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.094381:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6783 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.094395:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6783 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.094407:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6783 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.094416:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6783 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.094445:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211896.094517:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211896.094525:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6783 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.094533:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211896.094538:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6783 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.094547:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6783 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.094563:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6783 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.094571:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6783 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211896.094604:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.094606:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211896.094609:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788211896.095319:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788211896.095329:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a306af06/0x2afbce82f55a678a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.095352:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788211896.095356:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211896.095361:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a306af06/0x2afbce82f55a678a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.095373:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a306af06/0x2afbce82f55a678a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.095381:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a306af06/0x2afbce82f55a678a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.095387:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a306af06/0x2afbce82f55a678a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.095401:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211896.095412:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211896.095417:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a306af06/0x2afbce82f55a678a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.095425:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211896.095429:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a306af06/0x2afbce82f55a678a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.095436:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a306af06/0x2afbce82f55a678a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.095460:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a306af06/0x2afbce82f55a678a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.095467:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a306af06/0x2afbce82f55a678a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211896.095481:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.095482:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211896.095484:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788211896.095666:0:15120:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1788211896.095776:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14460:x1875075660873984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 112016us (112126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211896.095785:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788211896.095849:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef634e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1875075660873984:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788211896.095865:0:14460:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788211896.095909:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef634e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1875075660874112:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788211896.095944:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211896.095990:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcb07e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788211896.096009:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660874112 00000100:00100000:2.0:1788211896.096016:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660874112 00000100:00100000:2.0:1788211896.096055:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788211896.096064:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14460:x1875075660874112:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788211896.096502:0:15121:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1788211896.116535:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14460:x1875075660874112:12345-0@lo:5:osp-pre-0-0.0 Request processed in 20462us (20580us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788211896.116555:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788211896.116628:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef634e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1875075660874112:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788211896.116648:0:14460:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:1.0:1788211896.129580:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788211896.875632:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211897.897476:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211898.927677:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211899.943479:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788211900.878965:0:15843:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788211900.878971:0:15843:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788211900.879256:0:15843:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8abfef94e000 00000020:01000004:0.0:1788211900.879354:0:15843:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788211900.879369:0:15843:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788211900.879383:0:15843:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8abfd2a199b8) 00000020:00000080:0.0:1788211900.879397:0:15843:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788211900.894684:0:15843:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788211900.895122:0:15843:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788211900.897660:0:15843:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788211900.897986:0:15843:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788211900.898319:0:15843:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788211900.899104:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 203: rc = 0 00100000:10000000:0.0:1788211900.901101:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 203: rc = 0 00100000:10000000:0.0:1788211900.901398:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 203: rc = 0 00100000:10000000:0.0:1788211900.901926:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 457: rc = 0 00100000:10000000:0.0:1788211900.902263:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 457: rc = 0 00100000:10000000:0.0:1788211900.902508:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 457: rc = 0 00100000:10000000:0.0:1788211900.903921:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 457: rc = 0 00100000:10000000:0.0:1788211900.904359:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 457: rc = 0 00100000:10000000:0.0:1788211900.904635:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 457: rc = 0 00000020:00000080:0.0:1788211900.906359:0:15843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788211900.906374:0:15843:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788211900.906387:0:15843:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2afbce82f55a6798 00000020:01000004:0.0:1788211900.906395:0:15843:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788211900.906714:0:15843:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.129@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788211900.906718:0:15843:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788211900.906726:0:15843:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788211900.906754:0:15843:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788211900.906759:0:15843:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788211900.916602:0:15843:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788211900.916654:0:15843:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.129@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788211900.916659:0:15843:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788211900.916661:0:15843:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788211900.916663:0:15843:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788211900.916664:0:15843:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788211900.916665:0:15843:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788211900.916666:0:15843:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788211900.916669:0:15843:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788211900.916671:0:15843:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788211900.916672:0:15843:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788211900.916676:0:15843:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788211900.916679:0:15843:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788211900.916680:0:15843:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788211900.916681:0:15843:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788211900.916682:0:15843:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788211900.916683:0:15843:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788211900.916684:0:15843:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788211900.916685:0:15843:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788211900.916686:0:15843:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788211900.916687:0:15843:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788211900.916720:0:15843:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788211900.916742:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660874240:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788211900.916836:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211900.916945:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104780 going to sleep for 11 seconds 00000100:00100000:2.0:1788211900.916974:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660874240 00000100:00100000:2.0:1788211900.916986:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660874240 00000100:00100000:2.0:1788211900.917066:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788211900.917078:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15843:x1875075660874240:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788211900.917129:0:14432:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788211900.917132:0:14432:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788211900.917136:0:14432:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788211900.928865:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15843:x1875075660874240:12345-0@lo:253:mount.lustre.0 Request processed in 11777us (12017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211900.928882:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788211900.928992:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660874240:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788211900.929008:0:15843:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788211900.929011:0:15843:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788211900.929013:0:15843:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788211900.929029:0:15843:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788211900.929030:0:15843:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788211900.929032:0:15843:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788211900.929033:0:15843:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788211900.929034:0:15843:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788211900.929036:0:15843:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788211900.929038:0:15843:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788211900.929133:0:15843:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8abfef94e000 from lustre-OST0001 10000000:01000000:3.0:1788211900.929188:0:15843:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788211900.929191:0:15843:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788211900.929200:0:15843:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8abff7020000 local copy 00010000:00010000:3.0:1788211900.929213:0:15843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211900.929572:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660874368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788211900.929618:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211900.929671:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd87b2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788211900.929934:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660874368 00000100:00100000:1.0:1788211900.929945:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660874368 00000100:00100000:1.0:1788211900.929997:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788211900.930006:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00121a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15843:x1875075660874368:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211900.931870:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00121a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15843:x1875075660874368:12345-0@lo:501:mount.lustre.0 Request processed in 1853us (2239us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788211900.931888:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788211900.932094:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660874368:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788211900.932123:0:15843:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788211900.932497:0:15843:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788211900.932507:0:15843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211900.932516:0:15843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211900.932559:0:15843:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8abfef94e000 10000000:01000000:3.0:1788211900.932563:0:15843:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788211900.932568:0:15843:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788211900.932570:0:15843:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788211900.932573:0:15843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788211900.932576:0:15843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788211900.932615:0:15843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211900.932624:0:15843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211900.932636:0:15843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211900.932667:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660874496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788211900.932706:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211900.932742:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd87b2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788211900.932832:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660874496 00000100:00100000:2.0:1788211900.932841:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660874496 00000100:00100000:2.0:1788211900.932896:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788211900.932907:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00121a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+16:15843:x1875075660874496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788211900.932922:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211900.932936:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abffdb81200/0x2afbce82f55a67a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a679f expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211900.932963:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb81200/0x2afbce82f55a67a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a679f expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211900.932974:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abffdb81200/0x2afbce82f55a67a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a679f expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211900.932985:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81200, rc 0) 00000100:00100000:2.0:1788211900.933033:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00121a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+17:15843:x1875075660874496:12345-0@lo:101:mount.lustre.0 Request processed in 128us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211900.933050:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788211900.933212:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660874496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788211900.933228:0:15843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211900.933238:0:15843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788211900.933903:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788211900.934792:0:15843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788211900.935080:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788211900.935135:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788211900.935362:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788211900.935418:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788211900.935457:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788211900.935491:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788211900.935560:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788211900.935569:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788211900.935686:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660874624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788211900.935757:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211900.935805:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aa480 going to sleep for 11 seconds 00000100:00100000:1.0:1788211900.935920:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660874624 00000100:00100000:1.0:1788211900.935930:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660874624 00000100:00100000:1.0:1788211900.935985:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788211900.935996:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00121ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+17:15843:x1875075660874624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211900.936487:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00121ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+17:15843:x1875075660874624:12345-0@lo:501:mount.lustre.0 Request processed in 491us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211900.936502:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788211900.936613:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660874624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788211900.936675:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660874752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788211900.936718:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211900.936749:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aa480 going to sleep for 11 seconds 00000100:00100000:1.0:1788211900.936796:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660874752 00000100:00100000:1.0:1788211900.936801:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660874752 00000100:00100000:1.0:1788211900.936882:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788211900.936890:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+17:15843:x1875075660874752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211900.937237:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+17:15843:x1875075660874752:12345-0@lo:503:mount.lustre.0 Request processed in 347us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211900.937244:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788211900.937340:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660874752:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788211900.938244:0:15843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788211900.938338:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660874880:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788211900.938407:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211900.938535:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660874880 00000100:00100000:1.0:1788211900.938543:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660874880 00000100:00100000:2.0:1788211900.938630:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788211900.938642:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+17:15843:x1875075660874880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788211900.939002:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+17:15843:x1875075660874880:12345-0@lo:502:mount.lustre.0 Request processed in 361us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211900.939012:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788211900.942722:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aa480 going to sleep for 11 seconds 00000100:00100000:3.0:1788211900.942784:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660874880:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788211900.944296:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788211900.944391:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788211900.944427:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788211900.944490:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788211900.944528:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788211900.944561:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788211900.944630:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788211900.944688:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788211900.947332:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788211900.947419:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875008:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788211900.947519:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211900.950895:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aa480 going to sleep for 11 seconds 00000100:00100000:0.0:1788211900.952084:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660875008 00000100:00100000:0.0:1788211900.952098:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660875008 00000100:00100000:0.0:1788211900.952246:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788211900.952258:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+17:15843:x1875075660875008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788211900.952586:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+17:15843:x1875075660875008:12345-0@lo:502:mount.lustre.0 Request processed in 330us (5067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211900.952595:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788211900.952925:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875008:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788211900.953056:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788211900.953073:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788211900.959599:0:15844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788211900.959617:0:15844:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788211900.959624:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211900.959627:0:15844:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788211900.959635:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788211900.959674:0:15844:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8abfd2a9cd28) 00000020:00000080:3.0:1788211900.959705:0:15844:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788211900.959713:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788211900.959788:0:15844:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abfef94e000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788211900.959797:0:15844:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788211900.959805:0:15844:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2afbce82f55a67b4 00010000:00010000:1.0:1788211900.965767:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211900.965842:0:15844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788211900.966397:0:15844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788211900.972291:0:15844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788211900.979517:0:15844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788211900.979533:0:15844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211900.979540:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211900.979542:0:15844:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788211900.979547:0:15844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788211900.979553:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211900.979555:0:15844:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788211900.979558:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788211900.979560:0:15844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788211900.979580:0:15844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211900.979583:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211900.979585:0:15844:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788211900.979589:0:15844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788211900.979592:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211900.979593:0:15844:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788211900.979598:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788211900.979693:0:15844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211900.979697:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211900.979699:0:15844:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788211900.979703:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788211900.980095:0:15843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788211900.980125:0:15843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788211900.980151:0:15843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211900.980181:0:15843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211900.980200:0:15843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfef94e000 from 1 10000000:01000000:0.0:1788211900.980204:0:15843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788211900.980238:0:15843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211900.980246:0:15843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211900.980257:0:15843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211900.980291:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875136:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788211900.980360:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211900.980413:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff71046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211900.983699:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660875136 00000100:00100000:3.0:1788211900.983721:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660875136 00000100:00100000:3.0:1788211900.983806:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788211900.983818:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+17:15843:x1875075660875136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788211900.983838:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211900.983862:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6063800/0x2afbce82f55a67c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a67bb expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211900.983898:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6063800/0x2afbce82f55a67c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a67bb expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211900.983912:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6063800/0x2afbce82f55a67c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a67bb expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211900.983923:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063800, rc 0) 00000100:00100000:3.0:1788211900.984021:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+18:15843:x1875075660875136:12345-0@lo:101:mount.lustre.0 Request processed in 205us (3660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211900.984029:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788211900.984133:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875136:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788211900.984153:0:15843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67c2 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211900.985227:0:15843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a67c2 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788211900.985875:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788211900.987891:0:15843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788211900.989329:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788211900.989399:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788211900.989475:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788211900.989484:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788211900.989582:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788211900.989662:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211900.989711:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff71046c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211900.989906:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660875264 00000100:00100000:2.0:1788211900.989916:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660875264 00000100:00100000:2.0:1788211900.989974:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788211900.989985:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+18:15843:x1875075660875264:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788211900.990860:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+18:15843:x1875075660875264:12345-0@lo:501:mount.lustre.0 Request processed in 872us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211900.990874:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788211900.991597:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211900.991951:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211900.992321:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211900.992410:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211900.993615:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660875392 00000100:00100000:3.0:1788211900.993627:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660875392 00000100:00100000:1.0:1788211900.995536:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788211900.995558:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+18:15843:x1875075660875392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211900.995986:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+18:15843:x1875075660875392:12345-0@lo:503:mount.lustre.0 Request processed in 437us (3665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211900.996327:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788211900.996431:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875392:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788211900.997089:0:15843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788211900.998577:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875520:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788211900.998706:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211900.998860:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788211900.999088:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660875520 00000100:00100000:2.0:1788211900.999099:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660875520 00000100:00100000:2.0:1788211900.999183:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788211900.999200:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+18:15843:x1875075660875520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788211900.999473:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+18:15843:x1875075660875520:12345-0@lo:502:mount.lustre.0 Request processed in 275us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211900.999482:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788211900.999708:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875520:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788211900.999974:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788211901.000096:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788211901.000148:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788211901.000419:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788211901.000454:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788211901.000499:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788211901.000555:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788211901.000586:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788211901.000623:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788211901.000686:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211901.000770:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788211901.000808:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660875648 00000100:00100000:1.0:1788211901.000814:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660875648 00000100:00100000:1.0:1788211901.000861:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788211901.000872:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+18:15843:x1875075660875648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788211901.001564:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+18:15843:x1875075660875648:12345-0@lo:502:mount.lustre.0 Request processed in 691us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211901.001585:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788211901.001709:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788211901.001878:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788211901.001894:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788211901.003359:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788211901.003378:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211901.003380:0:15848:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788211901.003391:0:15848:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abfef94e000 00000020:00000080:3.0:1788211901.003395:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788211901.003404:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211901.003406:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211901.003408:0:15848:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788211901.003411:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788211901.003413:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211901.003414:0:15848:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788211901.003417:0:15848:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abfef94e000 00000020:00000080:3.0:1788211901.003419:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788211901.003486:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211901.003490:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211901.003491:0:15848:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788211901.003494:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788211901.003496:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211901.003497:0:15848:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788211901.003501:0:15848:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8abfef94e000 00000020:00000080:3.0:1788211901.003503:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788211901.003537:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211901.003540:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211901.003541:0:15848:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788211901.003544:0:15848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788211901.003692:0:15843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788211901.003714:0:15843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788211901.003735:0:15843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67c2 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211901.003747:0:15843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67c2 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211901.003800:0:15843:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788211901.003803:0:15843:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8abfef94e000 10000000:01000000:1.0:1788211901.003806:0:15843:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8abfef94e000 10000000:01000000:1.0:1788211901.003809:0:15843:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788211901.003815:0:15843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8abfef94e000 from 1 10000000:01000000:1.0:1788211901.003818:0:15843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788211901.003864:0:15843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211901.003873:0:15843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211901.003885:0:15843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211901.003912:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788211901.003973:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211901.004016:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc76c7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788211901.005839:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660875776 00000100:00100000:3.0:1788211901.005859:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660875776 00000100:00100000:3.0:1788211901.005932:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788211901.005944:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+18:15843:x1875075660875776:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788211901.005965:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211901.005987:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6062200/0x2afbce82f55a67d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a67c9 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.006037:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6062200/0x2afbce82f55a67d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a67c9 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.006049:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6062200/0x2afbce82f55a67d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a67c9 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.006061:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062200, rc 0) 00000100:00100000:3.0:1788211901.006140:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:15843:x1875075660875776:12345-0@lo:101:mount.lustre.0 Request processed in 197us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211901.006147:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788211901.006492:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788211901.006513:0:15843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211901.006532:0:15843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788211901.008109:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788211901.008618:0:15843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788211901.008956:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788211901.009003:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788211901.009037:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788211901.009083:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788211901.009120:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788211901.009206:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788211901.009253:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788211901.009288:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788211901.009353:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788211901.009391:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788211901.009426:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788211901.009475:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788211901.009511:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788211901.009545:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788211901.009592:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788211901.009625:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788211901.009671:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788211901.009716:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788211901.009750:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788211901.009779:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788211901.009816:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788211901.009849:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788211901.009880:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788211901.009923:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788211901.009970:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788211901.012122:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788211901.012441:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788211901.012485:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788211901.012520:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788211901.012568:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788211901.012603:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788211901.012635:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788211901.012689:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788211901.012738:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788211901.012773:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788211901.012817:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788211901.012851:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788211901.012961:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788211901.012969:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788211901.013415:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211901.013486:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211901.013538:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc76c7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788211901.013619:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660875904 00000100:00100000:0.0:1788211901.013628:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660875904 00000100:00100000:0.0:1788211901.013737:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788211901.013747:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:15843:x1875075660875904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788211901.014156:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:15843:x1875075660875904:12345-0@lo:501:mount.lustre.0 Request processed in 410us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211901.014184:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788211901.014445:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660875904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211901.014489:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660876032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211901.014533:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211901.014560:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660876032 00000100:00100000:1.0:1788211901.014565:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660876032 00000100:00100000:1.0:1788211901.014597:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788211901.014604:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+19:15843:x1875075660876032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211901.014781:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+19:15843:x1875075660876032:12345-0@lo:503:mount.lustre.0 Request processed in 177us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211901.014788:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788211901.014829:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc76c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788211901.014841:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660876032:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788211901.015680:0:15843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788211901.015778:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660876160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788211901.015836:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211901.015869:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc76c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788211901.016827:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660876160 00000100:00100000:1.0:1788211901.016837:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660876160 00000100:00100000:1.0:1788211901.016885:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788211901.016895:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:15843:x1875075660876160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788211901.017851:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:15843:x1875075660876160:12345-0@lo:502:mount.lustre.0 Request processed in 950us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211901.017864:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788211901.017952:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660876160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788211901.018674:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788211901.018736:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788211901.018762:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788211901.018799:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788211901.018828:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788211901.018878:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788211901.018909:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788211901.018935:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788211901.018975:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788211901.019021:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788211901.019053:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788211901.019098:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788211901.019129:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788211901.019156:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788211901.019961:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788211901.020033:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788211901.020091:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788211901.020138:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788211901.020568:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788211901.020608:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788211901.020666:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788211901.020699:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788211901.020730:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788211901.020775:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788211901.020808:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788211901.020850:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788211901.020897:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788211901.020930:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788211901.020962:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788211901.021146:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788211901.021409:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788211901.021464:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788211901.021497:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788211901.021543:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788211901.021577:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788211901.021624:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788211901.021673:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788211901.021708:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788211901.021757:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788211901.021793:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788211901.021856:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660876288:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788211901.021964:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211901.022185:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe2e49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211901.024569:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660876288 00000100:00100000:0.0:1788211901.024585:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660876288 00000100:00100000:0.0:1788211901.024668:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788211901.024680:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:15843:x1875075660876288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788211901.025133:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:15843:x1875075660876288:12345-0@lo:502:mount.lustre.0 Request processed in 454us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211901.025152:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788211901.025333:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660876288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788211901.025482:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788211901.025501:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788211901.027080:0:15853:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788211901.027108:0:15853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8abec66f19b8) 00000020:00000080:1.0:1788211901.027131:0:15853:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788211901.027883:0:15853:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abfef94e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788211901.027890:0:15853:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8abfef94e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788211901.027899:0:15853:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abfef94e000 3 00010000:00080000:1.0:1788211901.027937:0:15853:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abec7028800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.129@tcp at head 00010000:00010000:1.0:1788211901.029957:0:15853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788211901.030368:0:15853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788211901.030411:0:15853:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788211901.030427:0:15853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2afbce82f55a67de 00000100:00080000:1.0:1788211901.030440:0:15853:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788211901.030446:0:15853:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8abec7028800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211901.030493:0:15853:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001364e00 x1875075660876416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788211901.030524:0:15853:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788211901.030577:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788211901.030581:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788211901.030583:0:8:0:(import.c:65:import_set_state_nolock()) ffff8abfe472f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788211901.030587:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 485 00000100:00080000:1.0:1788211901.030592:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788211901.030596:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8abfe472f000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211901.030608:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001365c00 x1875075660876672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788211901.030677:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660876544:0@lo:400:kworker.0 00000100:00100000:1.0:1788211901.030854:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211901.030902:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788211901.030908:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660876800:0@lo:400:kworker.0 00000100:00100000:1.0:1788211901.030939:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211901.030978:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660876544 00000100:00100000:1.0:1788211901.030986:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660876544 00000100:00100000:1.0:1788211901.031061:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788211901.031069:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660876544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211901.031117:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660876544:12345-0@lo:400:kworker.0 Request processed in 49us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211901.031124:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788211901.031148:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660876800 00000100:00100000:1.0:1788211901.031151:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660876800 00000100:00100000:1.0:1788211901.031206:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788211901.031213:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660876800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211901.031410:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660876928:0@lo:400:kworker.0 00000100:00100000:2.0:1788211901.031454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211901.031494:0:14438:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788211901.031503:0:14438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788211901.031517:0:14437:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788211901.031526:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660876928 00000100:00100000:2.0:1788211901.031529:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660876928 00000100:00100000:2.0:1788211901.031547:0:14437:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788211901.031553:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788211901.031560:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660876928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211901.031594:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660876928:12345-0@lo:400:kworker.0 Request processed in 34us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211901.031599:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788211901.031763:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001365500 x1875075660876928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211901.031777:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660876928:0@lo:400:kworker.0 00000100:00100000:0.0:1788211901.032105:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875075660876416:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788211901.032142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211901.032194:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660876672:0@lo:8:kworker.0 00000100:00100000:0.0:1788211901.032239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211901.032249:0:14437:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788211901.032255:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660876416 00000100:00100000:2.0:1788211901.032259:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660876416 00000100:00100000:2.0:1788211901.032273:0:14437:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788211901.032280:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788211901.032285:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875075660876416:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788211901.032306:0:14437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:2.0:1788211901.032352:0:14437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2afbce82f55a67e5 00000004:00100000:2.0:1788211901.032366:0:14437:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788211901.032398:0:14437:0:(import.c:65:import_set_state_nolock()) ffff8abfcd476000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211901.032439:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875075660876416:12345-0@lo:38:llog_process_th.0 Request processed in 152us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211901.032454:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788211901.032479:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660876672 00000100:00100000:2.0:1788211901.032482:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660876672 00000100:00100000:2.0:1788211901.032500:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788211901.032505:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875075660876672:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788211901.032543:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875075660876672:12345-0@lo:8:kworker.0 Request processed in 37us (305us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788211901.032549:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788211901.032580:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001364e00 x1875075660876416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788211911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211901.032589:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788211901.032596:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788211901.032603:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788211901.032608:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788211901.032610:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec7028800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788211901.032616:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875075660876416:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788211901.032635:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788211901.032638:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfe472f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788211901.032652:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788211901.032655:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660876672:0@lo:8:kworker.0 00000100:00100000:1.0:1788211901.033124:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660876800:12345-0@lo:400:kworker.0 Request processed in 1909us (2181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211901.033134:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788211901.034083:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788211901.034091:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788211901.034151:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001364380 x1875075660876800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211901.034252:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660876800:0@lo:400:kworker.0 00000100:00100000:1.0:1788211901.034270:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660876544:0@lo:400:kworker.0 00000040:00080000:1.0:1788211901.035668:0:15853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788211901.035799:0:15843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788211901.035826:0:15843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788211901.035874:0:15843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211901.035897:0:15843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788211901.035940:0:15843:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788211901.035942:0:15843:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788211901.035943:0:15843:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211901.035944:0:15843:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211901.035946:0:15843:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211901.035947:0:15843:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211901.035948:0:15843:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788211901.035950:0:15843:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211901.035951:0:15843:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788211901.035955:0:15843:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788211901.035957:0:15843:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788211901.035958:0:15843:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788211901.035959:0:15843:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211901.035960:0:15843:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211901.035961:0:15843:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211901.035962:0:15843:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211901.035963:0:15843:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788211901.035964:0:15843:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211901.035965:0:15843:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788211901.035998:0:15843:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788211901.036018:0:15843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660877056:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788211901.036096:0:15843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211901.036131:0:15843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6631300 going to sleep for 11 seconds 00000100:00100000:1.0:1788211901.036423:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660877056 00000100:00100000:1.0:1788211901.036432:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660877056 00000100:00100000:1.0:1788211901.036470:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788211901.036479:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+19:15843:x1875075660877056:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788211901.036503:0:14431:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788211901.036515:0:14431:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788211901.071975:0:14431:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788211901.072004:0:14431:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788211901.072089:0:14453:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788211901.072094:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788211901.072117:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211901.072139:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a66bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a66b8 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211901.072415:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211901.072490:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a66bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a66b8 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211901.072509:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a66bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a66b8 expref: 19 pid: 14430 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211901.072527:0:14453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef637b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1875075660877184:0@lo:104: 00000100:00100000:2.0:1788211901.072629:0:14453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211901.072682:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660877184 00000100:00100000:2.0:1788211901.072689:0:14453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca4a0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788211901.072692:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660877184 00000100:00100000:3.0:1788211901.072845:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788211901.072857:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05b7e8c1-59a4-46a9-9396-986dc762646c+3:14453:x1875075660877184:12345-0@lo:104: 00010000:00010000:3.0:1788211901.072870:0:14421:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a66bf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.072927:0:14421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788211901.072933:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05b7e8c1-59a4-46a9-9396-986dc762646c+3:14453:x1875075660877184:12345-0@lo:104: Request processed in 80us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211901.072941:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788211901.073128:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211901.073136:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a66bf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211901.073144:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7a00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211901.073148:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a66bf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211901.073158:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a66bf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211901.073259:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a66bf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211901.073265:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1788211901.073282:0:14453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef637b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1875075660877184:0@lo:104: 00010000:00010000:0.0:1788211901.073293:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a66bf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211901.073299:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211901.073305:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211901.073321:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a66bf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211901.073403:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abff63c7a00/0x2afbce82f55a66b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a66bf expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211901.073433:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211901.073435:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211901.073437:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211901.073449:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660877312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211901.073482:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211901.073604:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660877312 00000100:00100000:3.0:1788211901.073610:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660877312 00010000:00010000:3.0:1788211901.073635:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a66bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a66b8 expref: 20 pid: 14430 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211901.073708:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788211901.073716:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+20:3309:x1875075660877312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211901.073737:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211901.073744:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a66bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a66b8 expref: 20 pid: 14430 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.073754:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a66bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a66b8 expref: 20 pid: 14430 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.073767:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a66bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a66b8 expref: 20 pid: 14430 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.073782:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.073790:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788211901.073804:0:14422:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002423572s 00010000:00010000:3.0:1788211901.073808:0:14422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.073815:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.073821:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.073827:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.073840:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211901.073845:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.073853:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.073866:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.073875:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211901.073905:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3309:x1875075660877312:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211901.073913:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788211901.074299:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660877312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211901.074508:0:14453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.074517:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211901.074524:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb81a00/0x2afbce82f55a67ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211901.097667:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+18:15843:x1875075660877056:12345-0@lo:253:mount.lustre.0 Request processed in 61165us (61547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211901.097696:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788211901.097929:0:15843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05b7e8c1-59a4-46a9-9396-986dc762646c:15843:1875075660877056:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788211901.097952:0:15843:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788211901.097956:0:15843:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788211901.097958:0:15843:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788211901.097960:0:15843:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788211901.097961:0:15843:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788211901.097963:0:15843:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788211901.097964:0:15843:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788211901.097966:0:15843:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788211901.097969:0:15843:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788211901.097970:0:15843:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788211901.098206:0:15843:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788211901.105133:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788211901.105482:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788211901.105807:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788211901.105953:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788211901.106463:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788211901.106670:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788211901.108735:0:15843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788211901.160874:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788211901.160900:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660877440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211901.161596:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211901.164473:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660877440 00000100:00100000:3.0:1788211901.164490:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660877440 00000100:00100000:3.0:1788211901.164547:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788211901.164558:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875075660877440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788211901.164600:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211901.164708:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875075660877440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (3723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211901.164725:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788211901.179078:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660877440:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1788211901.201382:0:15843:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788211901.201395:0:15843:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788211901.201442:0:15843:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788211901.201517:0:15843:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788211901.201531:0:15843:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788211901.201569:0:15843:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00080000:1.0:1788211901.261552:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1788211901.989355:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788211902.247826:0:14434:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788211902.247835:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ac00108a000 from 8 10000000:01000000:2.0:1788211902.247840:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788211902.247891:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211902.247904:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211902.247919:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211902.247945:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660877568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788211902.248011:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211902.248065:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcb07eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788211902.248191:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660877568 00000100:00100000:0.0:1788211902.248199:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660877568 00000100:00100000:0.0:1788211902.248262:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788211902.248273:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+18:14434:x1875075660877568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211902.248287:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211902.248302:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfca8cdc00/0x2afbce82f55a67fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a67f3 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211902.248326:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfca8cdc00/0x2afbce82f55a67fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a67f3 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211902.248351:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfca8cdc00/0x2afbce82f55a67fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a67f3 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211902.248360:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cdc00, rc 0) 00000100:00100000:0.0:1788211902.248419:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:14434:x1875075660877568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211902.248425:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788211902.248473:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660877568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211902.248486:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211902.248495:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211902.248555:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca87a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660877696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788211902.248585:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211902.248597:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffbc7e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788211902.250119:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660877696 00000100:00100000:2.0:1788211902.250133:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660877696 00000100:00100000:2.0:1788211902.250199:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788211902.250210:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:14434:x1875075660877696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788211902.250234:0:14432:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788211902.250251:0:14432:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788211902.250255:0:14432:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788211902.250393:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:14434:x1875075660877696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 185us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211902.250402:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788211902.250460:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca87a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660877696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788211902.250544:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788211902.250555:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211902.250575:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788211902.439514:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788211903.013946:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211904.037534:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211905.061411:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.094871:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788211906.278886:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788211906.278894:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788211906.278898:0:38:0:(import.c:65:import_set_state_nolock()) ffff8abfe472f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788211906.278912:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8abfe472f000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211906.278937:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001364e00 x1875075660878080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788211906.279066:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660877824:0@lo:400:kworker.0 00000100:00100000:2.0:1788211906.279367:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660877952:0@lo:400:kworker.0 00000100:00100000:2.0:1788211906.279407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211906.279460:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660878592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788211906.279482:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211906.279507:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211906.279513:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660878208:0@lo:400:kworker.0 00000100:00100000:2.0:1788211906.279550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211906.279580:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660878080:0@lo:8:kworker.0 00000100:00100000:2.0:1788211906.279602:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211906.279632:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660877952 00000100:00100000:2.0:1788211906.279641:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660877952 00000100:00100000:2.0:1788211906.279687:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660878080 00000100:00100000:2.0:1788211906.279690:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660878080 00000100:00100000:2.0:1788211906.279706:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211906.279716:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660877952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211906.279833:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660877952:12345-0@lo:400:kworker.0 Request processed in 119us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211906.279841:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211906.279858:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788211906.279862:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875075660878080:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788211906.279885:0:15119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000100:00100000:1.0:1788211906.279901:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788211906.279923:0:15119:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a6801 00000100:00100000:1.0:1788211906.279937:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660878464:0@lo:400:kworker.0 00002000:00100000:2.0:1788211906.279941:0:15119:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8abec5ada000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788211906.279947:0:15119:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788211906.279950:0:15119:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788211906.280038:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211906.280062:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788211906.280070:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660878336:0@lo:400:kworker.0 00000100:00100000:1.0:1788211906.280095:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211906.280135:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660878208 00000100:00100000:1.0:1788211906.280140:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660878208 00000100:00100000:1.0:1788211906.280316:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660878464 00000100:00100000:1.0:1788211906.280320:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660878464 00000100:00100000:1.0:1788211906.280349:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660878336 00000100:00100000:1.0:1788211906.280473:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660878336 00000100:00100000:1.0:1788211906.280496:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788211906.280502:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660878208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211906.280560:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660878208:12345-0@lo:400:kworker.0 Request processed in 58us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211906.280568:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788211906.280584:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788211906.280591:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660878464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211906.280699:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660878464:12345-0@lo:400:kworker.0 Request processed in 106us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211906.280839:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788211906.280856:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788211906.280864:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660878336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211906.280899:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660878336:12345-0@lo:400:kworker.0 Request processed in 36us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211906.280906:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00002000:00080000:2.0:1788211906.281017:0:15119:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788211906.281051:0:15119:0:(import.c:65:import_set_state_nolock()) ffff8abec5adb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211906.281098:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875075660878080:12345-0@lo:8:kworker.0 Request processed in 1234us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211906.281105:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788211906.281129:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660878592 00000100:00100000:2.0:1788211906.281133:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660878592 00000100:00100000:2.0:1788211906.281157:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788211906.281163:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660878592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788211906.281840:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211906.281879:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660878592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 716us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211906.281885:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788211906.281913:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788211906.281918:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788211906.281934:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660877824 00000100:00100000:2.0:1788211906.281938:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660877824 00000100:00100000:2.0:1788211906.281964:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788211906.281970:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3311:x1875075660877824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211906.281996:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3311:x1875075660877824:12345-0@lo:400:kworker.0 Request processed in 27us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211906.282003:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1788211906.283053:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001364e00 x1875075660878080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788211931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788211906.283080:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788211906.283091:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788211906.283097:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788211906.283100:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfe472f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788211906.283115:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788211906.283123:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660878080:0@lo:8:kworker.0 00000004:00080000:2.0:1788211906.283503:0:14462:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788211906.283527:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef637b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1875075660878848:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788211906.283588:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211906.283612:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe1139c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788211906.283631:0:14461:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788211906.284671:0:14461:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 495590501801ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788211906.284729:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660878720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211906.285911:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211906.285970:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660878720 00000100:00100000:2.0:1788211906.285979:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660878720 00000100:00100000:2.0:1788211906.286028:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788211906.286038:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875075660878720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211906.286071:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211906.286120:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875075660878720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211906.286127:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788211906.286146:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788211906.286932:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef635500 x1875075660878720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788211922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788211906.286965:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660878720:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788211906.287854:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001365180 x1875075660878336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211906.287868:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660878336:0@lo:400:kworker.0 00000100:00100000:1.0:1788211906.287880:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660877824:0@lo:400:kworker.0 00010000:00080000:1.0:1788211906.287891:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001364a80 x1875075660878464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211906.287900:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660878464:0@lo:400:kworker.0 00010000:00080000:1.0:1788211906.295128:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001365500 x1875075660878208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211906.295147:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660878208:0@lo:400:kworker.0 00000100:00100000:2.0:1788211906.296978:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660878848 00000100:00100000:2.0:1788211906.296994:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660878848 00000100:00100000:2.0:1788211906.297060:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788211906.297070:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14462:x1875075660878848:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788211906.297536:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788211906.297571:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660877952:0@lo:400:kworker.0 00000100:00100000:1.0:1788211906.298692:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660878592:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1788211906.313923:0:15119:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788211906.313937:0:15119:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788211906.313945:0:15119:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1788211906.329704:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.329731:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6808 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.329752:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.329758:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.329765:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.329788:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.329800:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.329944:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.329969:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.329986:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.329998:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.330006:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.330010:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.330019:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6808 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.330036:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6808 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.330044:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6808 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.330065:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.330067:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.330069:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.330755:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.330764:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a680f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.330775:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.330779:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.330784:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a680f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.332529:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a680f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.332560:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a680f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.332568:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a680f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.332600:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.332614:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.332620:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a680f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.332629:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.332635:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a680f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.332645:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a680f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.332671:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a680f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.332679:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a680f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.332994:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.332998:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.333000:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.333721:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.333731:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6816 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.333747:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.333752:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.333759:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6816 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.333775:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6816 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.333785:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6816 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.333799:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.333827:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.333839:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.333845:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.333865:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.333871:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.333880:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.333894:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6816 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.333901:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6816 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.333915:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.333917:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.333919:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.338729:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.338750:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a681d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.338767:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.338772:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.338779:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a681d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.338793:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a681d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.338815:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a681d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.338822:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a681d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.338841:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.338855:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.338860:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a681d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.338868:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.338874:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a681d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.338883:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a681d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.338902:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a681d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.338910:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a681d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.338930:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.338938:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.338940:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.344085:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.344099:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6824 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.344117:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.344122:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.344129:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.344157:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.344191:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.344200:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.344219:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.344232:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.344238:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.344246:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.344251:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.344271:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6824 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.344296:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6824 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.344305:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6824 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.344335:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.344337:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.344339:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788211906.346832:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1788211906.347493:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.347505:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a682b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.347523:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.347528:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.347535:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a682b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.347560:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a682b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.347569:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a682b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.347586:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a682b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.347605:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.347620:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.347625:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a682b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.347633:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.347639:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a682b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.347647:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a682b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.347666:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a682b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.347672:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a682b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.347690:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.347692:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.347694:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.348097:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.348111:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6832 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348121:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.348125:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.348129:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348139:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348147:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348155:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6832 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348200:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.348211:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.348215:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6832 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348223:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.348227:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6832 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348235:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6832 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348252:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6832 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348259:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6832 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348272:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.348274:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.348276:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.348689:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.348695:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6839 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348705:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.348709:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.348713:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348722:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348729:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348736:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6839 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348765:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.348776:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.348781:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6839 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348788:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.348792:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6839 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348801:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348814:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6839 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348821:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6839 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.348836:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.348838:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.348840:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.349276:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.349283:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6840 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.349292:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.349301:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.349306:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6840 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.349315:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6840 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.349323:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6840 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.349331:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6840 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.349345:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.349354:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.349358:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6840 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.349365:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.349368:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6840 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.349376:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6840 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.349386:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6840 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.351478:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6840 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.351506:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.351508:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.351510:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.353475:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.353490:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6847 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.353511:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.353516:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.353524:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6847 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.353550:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6847 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.353559:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6847 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.353566:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6847 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.353584:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.353608:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.353620:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6847 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.353792:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.353797:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6847 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.353807:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6847 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.353826:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6847 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.353833:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6847 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.353853:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.353856:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.353858:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.356088:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.356104:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a684e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.356120:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.356126:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.356134:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a684e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.356221:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a684e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.356233:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a684e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.356242:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a684e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.356277:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.356291:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.356297:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a684e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.356305:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.356902:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a684e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.356918:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a684e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.356943:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a684e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.356951:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a684e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.356980:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.356982:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.356985:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.362800:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.362817:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6855 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.362834:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.362838:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.362845:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6855 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.362860:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6855 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.362871:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6855 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.362879:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.362903:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.362924:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.362930:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.362952:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.362957:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.362968:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6855 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.362986:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6855 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.362994:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6855 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.363017:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.363019:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.363021:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.365051:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.365063:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a685c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.365079:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.365083:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.365089:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a685c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.365101:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a685c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.365119:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a685c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.365127:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a685c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.368494:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.368568:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.368579:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a685c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.368596:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.368601:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a685c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.368615:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a685c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.368716:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a685c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.368726:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a685c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.368756:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.368767:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.368769:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.369422:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.369430:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6863 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.369444:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.369448:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.369455:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6863 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.369467:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6863 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.369476:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6863 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.369484:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.369503:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788211906.369513:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.369518:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.369525:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.369535:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.369566:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6863 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.369579:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6863 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.369588:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6863 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788211906.372155:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788211906.373861:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.373864:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.373867:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.375043:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.375057:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a686a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.375074:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.375080:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.375088:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a686a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.375103:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a686a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.375116:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a686a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.375132:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a686a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.375195:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211906.375274:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211906.375283:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a686a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.375292:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211906.375296:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a686a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.375306:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a686a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.375331:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a686a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.375340:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a686a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.375365:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.375368:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.375370:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.375990:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.375998:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6871 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.376010:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.376013:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.376017:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6871 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.376029:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6871 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.376037:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6871 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.376045:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.376070:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211906.376588:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211906.376598:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.376607:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211906.376611:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.376620:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6871 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.376637:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6871 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.376645:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6871 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.376665:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.376667:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.376668:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788211906.379512:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788211906.379526:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6878 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.379563:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788211906.379569:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211906.379576:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.379601:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.379612:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.379620:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.380399:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788211906.380966:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788211906.380974:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a687f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.380986:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788211906.380995:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211906.381002:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a687f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.381015:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a687f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.381024:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a687f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.381032:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a687f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.381055:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788211906.381354:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788211906.381364:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381374:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211906.381379:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381401:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6878 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381420:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6878 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381429:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6878 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381454:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211906.381458:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a687f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381465:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211906.381468:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a687f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381476:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a687f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788211906.381477:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788211906.381489:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a90f3d/0x2afbce82f55a6886 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381493:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a687f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.381509:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788211906.381510:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a687f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.381518:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211906.381524:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a90f3d/0x2afbce82f55a6886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.381554:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a90f3d/0x2afbce82f55a6886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.381565:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a90f3d/0x2afbce82f55a6886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381569:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.381572:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.381576:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211906.381583:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019a90f3d/0x2afbce82f55a6886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.381596:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211906.381607:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211906.381614:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019a90f3d/0x2afbce82f55a6886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381621:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211906.381626:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a90f3d/0x2afbce82f55a6886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381634:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a90f3d/0x2afbce82f55a6886 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381645:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019a90f3d/0x2afbce82f55a6886 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381653:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a90f3d/0x2afbce82f55a6886 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.381668:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.381671:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.381673:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788211906.381986:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788211906.381991:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a688d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.381999:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788211906.382003:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211906.382006:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a688d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382015:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a688d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382022:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a688d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382029:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a688d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382050:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211906.382072:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211906.382078:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a688d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.382099:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211906.382103:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a688d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.382111:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a688d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.382125:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a688d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.382132:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000add8474e/0x2afbce82f55a688d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.382148:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.382151:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.382153:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788211906.382463:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788211906.382470:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6894 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382486:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788211906.382488:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211906.382492:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382501:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382508:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382514:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382535:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788211906.382933:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788211906.382939:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a9b5ae/0x2afbce82f55a689b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382948:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788211906.382951:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211906.382956:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a9b5ae/0x2afbce82f55a689b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382965:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a9b5ae/0x2afbce82f55a689b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382983:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a9b5ae/0x2afbce82f55a689b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.382991:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a9b5ae/0x2afbce82f55a689b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.383012:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788211906.383024:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788211906.383029:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.383038:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211906.383042:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.383050:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6894 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.383063:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6894 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.383071:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048874bd9/0x2afbce82f55a6894 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.383087:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211906.383096:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a9b5ae/0x2afbce82f55a689b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.383104:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211906.383107:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a9b5ae/0x2afbce82f55a689b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.383115:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a9b5ae/0x2afbce82f55a689b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.383126:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a9b5ae/0x2afbce82f55a689b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.383133:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a9b5ae/0x2afbce82f55a689b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.383144:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211906.383146:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211906.383148:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.383323:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.383518:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788211906.388077:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788211906.388091:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000604a57b8/0x2afbce82f55a68a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.388107:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788211906.388112:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211906.388118:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000604a57b8/0x2afbce82f55a68a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.388145:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000604a57b8/0x2afbce82f55a68a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.388156:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000604a57b8/0x2afbce82f55a68a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.388179:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000604a57b8/0x2afbce82f55a68a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.388213:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788211906.388232:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211906.388238:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000604a57b8/0x2afbce82f55a68a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.388247:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cde00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211906.388252:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000604a57b8/0x2afbce82f55a68a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.388261:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000604a57b8/0x2afbce82f55a68a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.388278:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000604a57b8/0x2afbce82f55a68a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.388286:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000604a57b8/0x2afbce82f55a68a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.388317:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211906.388320:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211906.388322:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788211906.388985:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788211906.388993:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef5e49a2/0x2afbce82f55a68a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.389002:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788211906.389005:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211906.389010:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef5e49a2/0x2afbce82f55a68a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.389020:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef5e49a2/0x2afbce82f55a68a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.389028:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef5e49a2/0x2afbce82f55a68a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.389035:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef5e49a2/0x2afbce82f55a68a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.389061:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788211906.389466:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788211906.389472:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d3490e3/0x2afbce82f55a68b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.389493:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788211906.389496:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211906.389501:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d3490e3/0x2afbce82f55a68b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.389509:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d3490e3/0x2afbce82f55a68b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.389517:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d3490e3/0x2afbce82f55a68b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.389524:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d3490e3/0x2afbce82f55a68b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.389556:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788211906.390278:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788211906.390288:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef5e49a2/0x2afbce82f55a68a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.390298:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.390302:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef5e49a2/0x2afbce82f55a68a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.390311:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef5e49a2/0x2afbce82f55a68a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.390344:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef5e49a2/0x2afbce82f55a68a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.390352:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef5e49a2/0x2afbce82f55a68a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.390371:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.390375:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d3490e3/0x2afbce82f55a68b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.390381:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.390385:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3490e3/0x2afbce82f55a68b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.390392:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3490e3/0x2afbce82f55a68b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.390401:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d3490e3/0x2afbce82f55a68b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.390409:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d3490e3/0x2afbce82f55a68b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.390420:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.390422:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.390431:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.391039:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788211906.391194:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788211906.391202:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a68b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.391214:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788211906.391217:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211906.391223:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a68b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.391234:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a68b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.391254:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a68b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.391262:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a68b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.391284:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788211906.391316:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211906.391324:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a68b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.391334:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211906.391339:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a68b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.391363:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a68b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.391380:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a68b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.391389:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a68b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211906.391412:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.391416:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211906.391420:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788211906.392890:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788211906.392901:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a68be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.392918:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788211906.392922:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211906.392928:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a68be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.392941:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a68be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.392952:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a68be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.392960:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a68be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211906.392993:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788211906.393201:0:15119:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1788211906.393307:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14462:x1875075660878848:12345-0@lo:5:osp-pre-1-0.0 Request processed in 96235us (109715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211906.393318:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788211906.393494:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211906.393502:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a68be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.393511:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211906.393516:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a68be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.393524:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a68be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.393552:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a68be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.393560:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a68be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211906.393582:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.393584:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211906.393585:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211906.393609:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef637b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1875075660878848:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788211906.393628:0:14462:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788211906.393676:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe091500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1875075660878976:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788211906.393715:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211906.393815:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc3d623c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211906.395652:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660878976 00000100:00100000:3.0:1788211906.395667:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660878976 00000100:00100000:0.0:1788211906.395828:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788211906.395841:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14462:x1875075660878976:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788211906.395906:0:15120:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788211906.403018:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14462:x1875075660878976:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7167us (9289us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788211906.403036:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788211906.406964:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe091500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1875075660878976:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788211906.406987:0:14462:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1788211907.111591:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211908.145476:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788211908.531750:0:16201:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788211909.157308:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211910.181503:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211911.157187:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.157587:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637813888 00000100:00100000:2.0:1788211911.157599:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637813888 00000100:00100000:2.0:1788211911.157698:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:2.0:1788211911.157706:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1875075637813888:12345-192.168.204.29@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788211911.157737:0:14430:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4e558780-c9b3-4785-b2cf-98ed47205561@192.168.204.29@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1788211911.157773:0:14430:0:(genops.c:1385:class_connect()) connect: client 4e558780-c9b3-4785-b2cf-98ed47205561, cookie 0x2afbce82f55a68c5 00000100:00080000:2.0:1788211911.157953:0:14430:0:(import.c:65:import_set_state_nolock()) ffff8abfef94a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211911.158062:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+5:2357:x1875075637813888:12345-192.168.204.29@tcp:250:mount.lustre.0 Request processed in 354us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.158069:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:2.0:1788211911.175326:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211911.175651:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637814016 00000100:00100000:0.0:1788211911.175663:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637814016 00000100:00100000:0.0:1788211911.175727:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:0.0:1788211911.175739:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+5:13766:x1875075637814016:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788211911.175759:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211911.175778:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfca8cc200/0x2afbce82f55a68cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5bd1 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211911.175812:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfca8cc200/0x2afbce82f55a68cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bd1 expref: 6 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211911.175845:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfca8cc200/0x2afbce82f55a68cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bd1 expref: 6 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211911.175855:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc200, rc 0) 00000100:00100000:0.0:1788211911.176672:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+6:13766:x1875075637814016:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 930us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211911.176682:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:3.0:1788211911.191324:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.191410:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637814144 00000100:00100000:2.0:1788211911.191422:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637814144 00000100:00100000:2.0:1788211911.191560:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:2.0:1788211911.191572:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+6:13766:x1875075637814144:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788211911.191938:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+6:13766:x1875075637814144:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 367us (626us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788211911.191948:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:3.0:1788211911.195658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211911.196237:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637814272 00000100:00100000:0.0:1788211911.196261:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637814272 00000100:00100000:0.0:1788211911.196326:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:0.0:1788211911.196345:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+6:13766:x1875075637814272:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788211911.196363:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211911.196381:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfca8cde00/0x2afbce82f55a68d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5bd8 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211911.196416:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfca8cde00/0x2afbce82f55a68d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bd8 expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211911.196429:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfca8cde00/0x2afbce82f55a68d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bd8 expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211911.196439:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cde00, rc 0) 00000100:00100000:0.0:1788211911.196682:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+7:13766:x1875075637814272:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 346us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211911.196690:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:3.0:1788211911.201928:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211911.204432:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637814400 00000100:00100000:0.0:1788211911.204487:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637814400 00000100:00100000:0.0:1788211911.204570:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:0.0:1788211911.204582:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+7:13766:x1875075637814400:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788211911.204966:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+8:13766:x1875075637814400:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 384us (3049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211911.204975:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 80 00010000:00010000:0.0:1788211911.205490:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211911.207218:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.207437:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637814528 00000100:00100000:2.0:1788211911.207457:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637814528 00000100:00100000:2.0:1788211911.207509:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:2.0:1788211911.207519:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+8:13766:x1875075637814528:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788211911.207827:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+8:13766:x1875075637814528:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 308us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.207835:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:3.0:1788211911.221598:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.222249:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637814656 00000100:00100000:2.0:1788211911.222260:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637814656 00000100:00100000:2.0:1788211911.222327:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 82 00000100:00100000:2.0:1788211911.222339:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+8:13785:x1875075637814656:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788211911.223909:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+8:13785:x1875075637814656:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 1389us (5846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.223930:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 82 00000100:00100000:3.0:1788211911.264902:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211911.265004:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637814784 00000100:00100000:0.0:1788211911.265018:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637814784 00000100:00100000:0.0:1788211911.265104:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:0.0:1788211911.265116:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+8:13785:x1875075637814784:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788211911.265547:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+8:13785:x1875075637814784:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 430us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211911.265556:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:2.0:1788211911.271038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211911.271226:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637814912 00000100:00100000:1.0:1788211911.271238:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637814912 00000100:00100000:1.0:1788211911.271315:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:1.0:1788211911.271327:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+8:13766:x1875075637814912:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788211911.271345:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211911.271366:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37ba00/0x2afbce82f55a68da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5c02 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211911.271404:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37ba00/0x2afbce82f55a68da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c02 expref: 9 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211911.271416:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37ba00/0x2afbce82f55a68da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c02 expref: 9 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211911.271427:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37ba00, rc 0) 00000100:00100000:1.0:1788211911.271872:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+9:13766:x1875075637814912:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 544us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211911.271881:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:2.0:1788211911.303304:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211911.303517:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637815040 00000100:00100000:0.0:1788211911.303531:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637815040 00000100:00100000:0.0:1788211911.303595:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:0.0:1788211911.303607:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+9:13766:x1875075637815040:12345-192.168.204.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788211911.303654:0:14430:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788211911.303684:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788211911.303688:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788211911.303692:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788211911.303694:0:14430:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788211911.307993:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+9:13766:x1875075637815040:12345-192.168.204.29@tcp:256:mount.lustre.0 Request processed in 4373us (4685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.308008:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:3.0:1788211911.320544:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211911.321022:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637815168 00000100:00100000:1.0:1788211911.321035:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637815168 00000100:00100000:1.0:1788211911.321119:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00100000:1.0:1788211911.321130:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+9:13766:x1875075637815168:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788211911.321151:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211911.321216:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a68e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5c09 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211911.321248:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a68e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c09 expref: 10 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211911.321259:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a68e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c09 expref: 10 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211911.321269:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37ac00, rc 0) 00000100:00100000:1.0:1788211911.321340:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+10:13766:x1875075637815168:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 211us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211911.321347:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00100000:0.0:1788211911.323848:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.324103:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637815296 00000100:00100000:2.0:1788211911.324115:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637815296 00000100:00100000:2.0:1788211911.324225:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 87 00000100:00100000:2.0:1788211911.324237:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+10:13766:x1875075637815296:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788211911.324628:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+10:13766:x1875075637815296:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 391us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.324638:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 87 00000100:00100000:1.0:1788211911.328560:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.329530:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637815424 00000100:00100000:2.0:1788211911.329544:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637815424 00000100:00100000:2.0:1788211911.329708:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:2.0:1788211911.329723:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+10:13766:x1875075637815424:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788211911.331001:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+10:13766:x1875075637815424:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 1269us (2438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.331015:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:2.0:1788211911.341893:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211911.341999:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637815552 00000100:00100000:1.0:1788211911.342009:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637815552 00000100:00100000:1.0:1788211911.342111:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 89 00000100:00100000:1.0:1788211911.342124:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+10:13790:x1875075637815552:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788211911.342788:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+10:13790:x1875075637815552:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 664us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211911.342799:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 89 00000100:00100000:0.0:1788211911.350528:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.350689:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637815680 00000100:00100000:2.0:1788211911.350703:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637815680 00000100:00100000:2.0:1788211911.350770:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 90 00000100:00100000:2.0:1788211911.350781:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+10:13790:x1875075637815680:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788211911.351074:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+10:13790:x1875075637815680:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 293us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.351092:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 90 00000100:00100000:3.0:1788211911.355691:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.356305:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637815808 00000100:00100000:2.0:1788211911.356319:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637815808 00000100:00100000:2.0:1788211911.356473:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:2.0:1788211911.356485:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1875075637815808:12345-192.168.204.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788211911.356526:0:14437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8710d9ba-217c-48be-aa23-80b8773d543b@192.168.204.29@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1788211911.356601:0:14437:0:(genops.c:1385:class_connect()) connect: client 8710d9ba-217c-48be-aa23-80b8773d543b, cookie 0x2afbce82f55a68e8 00000004:00100000:2.0:1788211911.356775:0:14437:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788211911.356784:0:14437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788211911.398157:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660879104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211911.398278:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211911.398703:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660879104 00000100:00100000:2.0:1788211911.398713:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660879104 00000100:00100000:2.0:1788211911.398773:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788211911.398784:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660879104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211911.398829:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211911.398887:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660879104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.398895:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788211911.402514:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788211911.402599:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660879104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211911.406576:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660879360:0@lo:400:kworker.0 00000100:00100000:1.0:1788211911.406668:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211911.407596:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660879872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211911.407647:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211911.407771:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211911.407782:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660879488:0@lo:400:kworker.0 00000100:00100000:1.0:1788211911.407950:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211911.409514:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660879360 00000100:00100000:1.0:1788211911.409529:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660879360 00000100:00100000:1.0:1788211911.409653:0:15617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788211911.409676:0:15617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660879360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211911.410409:0:15617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660879360:12345-0@lo:400:kworker.0 Request processed in 744us (3739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211911.410419:0:15617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788211911.410428:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211911.410471:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660879872 00000100:00100000:1.0:1788211911.410478:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660879872 00000100:00100000:1.0:1788211911.410525:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788211911.410536:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660879872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788211911.410567:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211911.410608:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660879872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211911.410614:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788211911.410635:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660879488 00000100:00100000:1.0:1788211911.410639:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660879488 00000100:00100000:1.0:1788211911.410668:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788211911.410742:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660879488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211911.411554:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660879488:12345-0@lo:400:kworker.0 Request processed in 876us (3600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211911.411564:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788211911.411885:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001203480 x1875075660879488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211911.411920:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660879488:0@lo:400:kworker.0 00000100:00100000:1.0:1788211911.411969:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660879360:0@lo:400:kworker.0 00000100:00100000:1.0:1788211911.411989:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660879872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211911.413499:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660879232:0@lo:400:kworker.0 00000100:00100000:1.0:1788211911.413577:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211911.413638:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660879744:0@lo:400:kworker.0 00000100:00100000:1.0:1788211911.413781:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211911.413889:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788211911.413898:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660879616:0@lo:400:kworker.0 00000100:00100000:1.0:1788211911.413925:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211911.413961:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660879744 00000100:00100000:1.0:1788211911.413974:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660879744 00000100:00100000:1.0:1788211911.414038:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660879616 00000100:00100000:1.0:1788211911.414042:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660879616 00000100:00100000:1.0:1788211911.414150:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788211911.414187:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660879744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211911.414391:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660879744:12345-0@lo:400:kworker.0 Request processed in 231us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211911.414399:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788211911.414423:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788211911.414433:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660879616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211911.414477:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660879616:12345-0@lo:400:kworker.0 Request processed in 46us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211911.414483:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788211911.414523:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001202d80 x1875075660879616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211911.414596:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660879616:0@lo:400:kworker.0 00010000:00080000:1.0:1788211911.414633:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001200e00 x1875075660879744/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788211927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211911.414659:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660879744:0@lo:400:kworker.0 00000100:00080000:1.0:1788211911.414953:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211911.414991:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660879232 00000100:00100000:1.0:1788211911.414997:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660879232 00000100:00100000:1.0:1788211911.415428:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788211911.415461:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3311:x1875075660879232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211911.415588:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3311:x1875075660879232:12345-0@lo:400:kworker.0 Request processed in 117us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211911.415599:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788211911.416630:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660879232:0@lo:400:kworker.0 00000100:00080000:2.0:1788211911.427909:0:14437:0:(import.c:65:import_set_state_nolock()) ffff8abfc288d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211911.428160:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+6:2357:x1875075637815808:12345-192.168.204.29@tcp:38:mount.lustre.0 Request processed in 71672us (72827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.428192:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:2.0:1788211911.437138:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.437257:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.437294:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637816064 00000100:00100000:2.0:1788211911.437306:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637816064 00000100:00100000:2.0:1788211911.437384:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637815936 00000100:00100000:2.0:1788211911.437388:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637815936 00000100:00100000:2.0:1788211911.437410:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:2.0:1788211911.437422:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+7:13766:x1875075637816064:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788211911.437488:0:14438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788211911.437647:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+7:13766:x1875075637816064:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 227us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.437655:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:2.0:1788211911.437673:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:2.0:1788211911.437681:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+6:0:x1875075637815936:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788211911.437692:0:14438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788211911.437716:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+6:0:x1875075637815936:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 37us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.437723:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00080000:2.0:1788211911.437740:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211911.440023:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211911.440098:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637816192 00000100:00100000:3.0:1788211911.440108:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637816192 00000100:00100000:3.0:1788211911.440183:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:3.0:1788211911.440194:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+6:13766:x1875075637816192:12345-192.168.204.29@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788211911.440268:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+6:13766:x1875075637816192:12345-192.168.204.29@tcp:40:mount.lustre.0 Request processed in 76us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211911.440276:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:2.0:1788211911.449853:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.449896:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.449924:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211911.449955:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637816320 00000100:00100000:2.0:1788211911.449964:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637816320 00000100:00100000:2.0:1788211911.450001:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637816448 00000100:00100000:2.0:1788211911.450003:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637816448 00000100:00100000:2.0:1788211911.450023:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:2.0:1788211911.450033:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875075637816320:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788211911.450083:0:15120:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8710d9ba-217c-48be-aa23-80b8773d543b@192.168.204.29@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1788211911.450123:0:15120:0:(genops.c:1385:class_connect()) connect: client 8710d9ba-217c-48be-aa23-80b8773d543b, cookie 0x2afbce82f55a68ef 00002000:00100000:2.0:1788211911.450135:0:15120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8710d9ba-217c-48be-aa23-80b8773d543b/ffff8abfc6407800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788211911.450147:0:15120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788211911.450590:0:15120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788211911.450625:0:15120:0:(import.c:65:import_set_state_nolock()) ffff8abfc6400000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211911.450689:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8710d9ba-217c-48be-aa23-80b8773d543b+6:2357:x1875075637816320:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 656us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.450697:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:2.0:1788211911.450725:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1788211911.450731:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875075637816448:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788211911.450747:0:15120:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8710d9ba-217c-48be-aa23-80b8773d543b@192.168.204.29@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1788211911.450766:0:15120:0:(genops.c:1385:class_connect()) connect: client 8710d9ba-217c-48be-aa23-80b8773d543b, cookie 0x2afbce82f55a68f6 00002000:00100000:2.0:1788211911.450773:0:15120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8710d9ba-217c-48be-aa23-80b8773d543b/ffff8abec67d4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788211911.450779:0:15120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788211911.450982:0:15120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788211911.450998:0:15120:0:(import.c:65:import_set_state_nolock()) ffff8abec67d5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211911.451025:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8710d9ba-217c-48be-aa23-80b8773d543b+6:2357:x1875075637816448:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 292us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211911.451033:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:3.0:1788211911.451393:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637816576 00000100:00100000:3.0:1788211911.451400:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637816576 00000100:00100000:3.0:1788211911.451437:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:3.0:1788211911.451455:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+6:13766:x1875075637816576:12345-192.168.204.29@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788211911.452018:0:14440:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 500us 00000001:00080000:1.0:1788211911.495268:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000004:00200000:3.0:1788211911.499671:0:14440:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788211911.500198:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+6:13766:x1875075637816576:12345-192.168.204.29@tcp:33:mount.lustre.0 Request processed in 48736us (50264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211911.500212:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:2.0:1788211911.805596:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211911.807762:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637816704 00000100:00100000:0.0:1788211911.807796:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637816704 00000100:00100000:0.0:1788211911.807972:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:0.0:1788211911.807987:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+6:13811:x1875075637816704:12345-192.168.204.29@tcp:101:mkdir.0 00010000:00010000:0.0:1788211911.808011:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211911.808036:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a68fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5c33 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211911.808112:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6904 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211911.808127:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211911.808143:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211911.811458:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788211911.811464:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788211911.811571:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211911.811622:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a68fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c33 expref: 8 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211911.811645:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6904 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c33 expref: 7 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211911.811656:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:0.0:1788211911.811659:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788211911.811664:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc000, rc 0) 00000100:00100000:0.0:1788211911.811839:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+7:13811:x1875075637816704:12345-192.168.204.29@tcp:101:mkdir.0 Request processed in 3853us (8765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211911.811849:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00010000:00010000:3.0:1788211912.232519:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788211912.677842:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788211913.253390:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211913.893785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211913.894286:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637816832 00000100:00100000:3.0:1788211913.894313:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637816832 00000100:00080000:2.0:1788211913.894444:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211913.894489:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:3.0:1788211913.894500:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+7:13863:x1875075637816832:12345-192.168.204.29@tcp:41:lfs.0 00000004:00000024:3.0:1788211913.894542:0:14438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788211913.894627:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+7:13863:x1875075637816832:12345-192.168.204.29@tcp:41:lfs.0 Request processed in 129us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211913.894634:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1788211913.898609:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211913.898737:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637816960 00000100:00100000:0.0:1788211913.898746:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637816960 00000100:00100000:0.0:1788211913.898817:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:0.0:1788211913.898827:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8710d9ba-217c-48be-aa23-80b8773d543b+6:13863:x1875075637816960:12345-192.168.204.29@tcp:13:lfs.0 00002000:00000024:0.0:1788211913.898875:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211913.898996:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8710d9ba-217c-48be-aa23-80b8773d543b+6:13863:x1875075637816960:12345-192.168.204.29@tcp:13:lfs.0 Request processed in 170us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211913.899012:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00080000:2.0:1788211913.899182:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788211913.902344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211913.902461:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637817088 00000100:00100000:0.0:1788211913.902473:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637817088 00000100:00100000:0.0:1788211913.902541:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:0.0:1788211913.902553:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8710d9ba-217c-48be-aa23-80b8773d543b+6:13863:x1875075637817088:12345-192.168.204.29@tcp:13:lfs.0 00002000:00000024:0.0:1788211913.902597:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211913.902709:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8710d9ba-217c-48be-aa23-80b8773d543b+6:13863:x1875075637817088:12345-192.168.204.29@tcp:13:lfs.0 Request processed in 158us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211913.902716:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00080000:2.0:1788211913.903134:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788211914.097292:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211914.097647:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637817216 00000100:00100000:0.0:1788211914.097670:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637817216 00000100:00100000:0.0:1788211914.097729:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 92 00000100:00100000:0.0:1788211914.097740:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec52f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+10:13895:x1875075637817216:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788211914.097758:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211914.097794:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfca8cd600/0x2afbce82f55a690b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5c3a expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211914.097827:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfca8cd600/0x2afbce82f55a690b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c3a expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211914.097841:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfca8cd600/0x2afbce82f55a690b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c3a expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211914.097851:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd600, rc 0) 00000100:00100000:0.0:1788211914.097983:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec52f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+11:13895:x1875075637817216:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 244us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211914.097990:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 92 00000100:00100000:3.0:1788211914.113291:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211914.113474:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637817344 00000100:00100000:1.0:1788211914.113568:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637817344 00000100:00100000:1.0:1788211914.113642:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 93 00000100:00100000:1.0:1788211914.113656:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc5116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+11:13895:x1875075637817344:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788211914.114983:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc5116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+11:13895:x1875075637817344:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 817us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211914.114999:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 93 00000100:00100000:2.0:1788211914.127012:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211914.127962:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637817472 00000100:00100000:1.0:1788211914.127991:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637817472 00000100:00100000:1.0:1788211914.128057:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 94 00000100:00100000:1.0:1788211914.128067:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc4b17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+11:13895:x1875075637817472:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788211914.128735:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc4b17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+11:13895:x1875075637817472:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 663us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211914.128745:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 94 00000100:00100000:3.0:1788211914.145836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211914.146209:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637817600 00000100:00100000:1.0:1788211914.146221:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637817600 00000100:00100000:1.0:1788211914.146352:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 95 00000100:00100000:1.0:1788211914.146364:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc4b16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+11:13902:x1875075637817600:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788211914.150088:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc4b16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+11:13902:x1875075637817600:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 3713us (4252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211914.150104:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 95 00000100:00100000:3.0:1788211914.168313:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211914.168432:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637817728 00000100:00100000:0.0:1788211914.168443:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637817728 00000100:00100000:0.0:1788211914.168511:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 96 00000100:00100000:0.0:1788211914.168522:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc4b17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+11:13902:x1875075637817728:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788211914.169508:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc4b17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+11:13902:x1875075637817728:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 979us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211914.169521:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 96 00000100:00100000:2.0:1788211914.183702:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211914.184259:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637817856 00000100:00100000:1.0:1788211914.184348:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637817856 00000100:00100000:1.0:1788211914.184435:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 97 00000100:00100000:1.0:1788211914.184449:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+11:13895:x1875075637817856:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788211914.184467:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211914.185073:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a6912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5c64 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211914.185110:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a6912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c64 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211914.185122:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a6912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c64 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211914.185397:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37b200, rc 0) 00000100:00100000:1.0:1788211914.185706:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+12:13895:x1875075637817856:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 1259us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211914.185714:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 97 00000100:00100000:2.0:1788211914.190474:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211914.190697:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637817984 00000100:00100000:1.0:1788211914.190708:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637817984 00000100:00100000:1.0:1788211914.190777:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 98 00000100:00100000:1.0:1788211914.190789:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+12:13895:x1875075637817984:12345-192.168.204.29@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788211914.190841:0:14430:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788211914.190879:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788211914.190885:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788211914.190889:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788211914.190891:0:14430:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788211914.200348:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+12:13895:x1875075637817984:12345-192.168.204.29@tcp:256:mount.lustre.0 Request processed in 9546us (9871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211914.200366:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 98 00000100:00100000:0.0:1788211914.206500:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211914.206616:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637818112 00000100:00100000:1.0:1788211914.206627:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637818112 00000100:00100000:1.0:1788211914.206703:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 99 00000100:00100000:1.0:1788211914.206715:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+12:13895:x1875075637818112:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788211914.206738:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211914.206764:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a6919 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5c6b expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211914.206804:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a6919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c6b expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211914.206834:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a6919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c6b expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211914.206862:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfcb37a600, rc 0) 00000100:00100000:1.0:1788211914.206939:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+13:13895:x1875075637818112:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 225us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211914.206946:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 99 00000100:00100000:2.0:1788211914.210080:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211914.210660:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637818240 00000100:00100000:1.0:1788211914.210675:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637818240 00000100:00100000:1.0:1788211914.210787:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 100 00000100:00100000:1.0:1788211914.210801:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+13:13895:x1875075637818240:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788211914.211257:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+13:13895:x1875075637818240:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 458us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211914.211266:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 100 00000100:00100000:3.0:1788211914.216377:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211914.216684:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637818368 00000100:00100000:2.0:1788211914.216699:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637818368 00000100:00100000:2.0:1788211914.216778:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 101 00000100:00100000:2.0:1788211914.216790:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+13:13895:x1875075637818368:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788211914.217982:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+13:13895:x1875075637818368:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 1184us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211914.217997:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 101 00000100:00100000:0.0:1788211914.224849:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211914.227529:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637818496 00000100:00100000:1.0:1788211914.227547:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637818496 00000100:00100000:1.0:1788211914.227639:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 102 00000100:00100000:1.0:1788211914.227652:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+13:13907:x1875075637818496:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788211914.228064:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+13:13907:x1875075637818496:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 412us (3225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211914.228073:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 102 00000100:00100000:3.0:1788211914.232779:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211914.233001:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637818624 00000100:00100000:2.0:1788211914.233014:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637818624 00000100:00100000:2.0:1788211914.233151:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 103 00000100:00100000:2.0:1788211914.233185:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd851cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+13:13907:x1875075637818624:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788211914.233530:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd851cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+13:13907:x1875075637818624:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 368us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211914.233538:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 103 00000100:00100000:3.0:1788211914.238855:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211914.239325:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637818752 00000100:00100000:1.0:1788211914.239340:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637818752 00000100:00100000:1.0:1788211914.239419:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:1.0:1788211914.239430:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2357:x1875075637818752:12345-192.168.204.29@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788211914.239491:0:15854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fdc55821-3eda-44a9-a166-1b5bcc681382@192.168.204.29@tcp t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:1.0:1788211914.239538:0:15854:0:(genops.c:1385:class_connect()) connect: client fdc55821-3eda-44a9-a166-1b5bcc681382, cookie 0x2afbce82f55a6920 00000004:00100000:1.0:1788211914.239584:0:15854:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788211914.240489:0:15854:0:(import.c:65:import_set_state_nolock()) ffff8abec7029000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788211914.240584:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2357:x1875075637818752:12345-192.168.204.29@tcp:38:mount.lustre.0 Request processed in 1152us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211914.240596:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:0.0:1788211914.248235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211914.248273:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211914.248453:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637819008 00000100:00100000:1.0:1788211914.248464:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637819008 00000100:00100000:1.0:1788211914.248535:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637818880 00000100:00100000:1.0:1788211914.248538:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637818880 00000100:00100000:1.0:1788211914.248563:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:1.0:1788211914.248573:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+7:13895:x1875075637819008:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788211914.248608:0:14439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788211914.248696:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+7:13895:x1875075637819008:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 124us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211914.248704:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:1.0:1788211914.248728:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:1.0:1788211914.248734:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+6:0:x1875075637818880:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788211914.248748:0:14439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788211914.248770:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+6:0:x1875075637818880:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 36us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211914.248776:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00080000:2.0:1788211914.249129:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211914.253675:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211914.253884:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637819136 00000100:00100000:1.0:1788211914.253896:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637819136 00000100:00100000:1.0:1788211914.253983:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:1.0:1788211914.253996:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+6:13895:x1875075637819136:12345-192.168.204.29@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788211914.254348:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+6:13895:x1875075637819136:12345-192.168.204.29@tcp:40:mount.lustre.0 Request processed in 350us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211914.254359:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:3.0:1788211914.256999:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211914.257304:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211914.257334:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211914.257420:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637819520 00000100:00100000:0.0:1788211914.257430:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637819520 00000100:00100000:0.0:1788211914.257489:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:0.0:1788211914.257500:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+6:13895:x1875075637819520:12345-192.168.204.29@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788211914.257863:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788211914.258009:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+6:13895:x1875075637819520:12345-192.168.204.29@tcp:33:mount.lustre.0 Request processed in 510us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211914.258019:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:2.0:1788211914.264631:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637819264 00000100:00100000:2.0:1788211914.264654:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637819264 00000100:00100000:2.0:1788211914.264733:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637819392 00000100:00100000:2.0:1788211914.264737:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637819392 00000100:00100000:2.0:1788211914.264777:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:2.0:1788211914.264786:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875075637819264:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788211914.265127:0:15120:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fdc55821-3eda-44a9-a166-1b5bcc681382@192.168.204.29@tcp t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:2.0:1788211914.265161:0:15120:0:(genops.c:1385:class_connect()) connect: client fdc55821-3eda-44a9-a166-1b5bcc681382, cookie 0x2afbce82f55a6927 00002000:00100000:2.0:1788211914.265206:0:15120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fdc55821-3eda-44a9-a166-1b5bcc681382/ffff8abec67d0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788211914.265217:0:15120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788211914.265500:0:15120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788211914.265606:0:15120:0:(import.c:65:import_set_state_nolock()) ffff8abec67d7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211914.265696:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2357:x1875075637819264:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 908us (8718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211914.265705:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:2.0:1788211914.265740:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1788211914.265747:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875075637819392:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788211914.265765:0:15120:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fdc55821-3eda-44a9-a166-1b5bcc681382@192.168.204.29@tcp t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:2.0:1788211914.265784:0:15120:0:(genops.c:1385:class_connect()) connect: client fdc55821-3eda-44a9-a166-1b5bcc681382, cookie 0x2afbce82f55a692e 00002000:00100000:2.0:1788211914.265790:0:15120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fdc55821-3eda-44a9-a166-1b5bcc681382/ffff8abec67d2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788211914.265930:0:15120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788211914.266000:0:15120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788211914.266039:0:15120:0:(import.c:65:import_set_state_nolock()) ffff8abffe067000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788211914.266067:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2357:x1875075637819392:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 319us (8732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211914.266075:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00010000:00010000:0.0:1788211914.278730:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211914.515269:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211914.515376:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637819648 00000100:00100000:3.0:1788211914.515398:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637819648 00000100:00100000:3.0:1788211914.515474:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:3.0:1788211914.515486:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+6:13928:x1875075637819648:12345-192.168.204.29@tcp:101:mkdir.0 00010000:00010000:3.0:1788211914.515509:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211914.515533:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062a00/0x2afbce82f55a6935 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5c95 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211914.515610:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a693c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211914.515641:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a693c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211914.515654:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a693c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211914.515876:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788211914.515880:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211914.516110:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a693c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211914.516881:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062a00/0x2afbce82f55a6935 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c95 expref: 8 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211914.517048:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a693c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c95 expref: 7 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211914.517057:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:3.0:1788211914.517060:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788211914.517064:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063c00, rc 0) 00000100:00100000:3.0:1788211914.517402:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+7:13928:x1875075637819648:12345-192.168.204.29@tcp:101:mkdir.0 Request processed in 1916us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211914.517412:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00010000:00010000:3.0:1788211915.301466:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211916.325417:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211916.518452:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660880000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211916.518534:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211916.518598:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660880512:0@lo:400:kworker.0 00000100:00100000:3.0:1788211916.518648:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211916.518676:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788211916.518681:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660880384:0@lo:400:kworker.0 00000100:00100000:3.0:1788211916.518706:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211916.518732:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660880128:0@lo:400:kworker.0 00000100:00100000:3.0:1788211916.518760:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211916.518784:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660880640:0@lo:400:kworker.0 00000100:00100000:3.0:1788211916.518811:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211916.518831:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660880000 00000100:00100000:1.0:1788211916.518840:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660880000 00000100:00100000:3.0:1788211916.518881:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788211916.518889:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660880256:0@lo:400:kworker.0 00000100:00100000:1.0:1788211916.518895:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788211916.518904:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660880000:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211916.518910:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211916.518927:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660880768:0@lo:400:kworker.0 00002000:00000024:1.0:1788211916.518935:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211916.518947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211916.518978:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660880000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211916.518985:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788211916.519012:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211916.519037:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660880128 00000100:00100000:1.0:1788211916.519040:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660880128 00000100:00100000:1.0:1788211916.519064:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788211916.519071:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3310:x1875075660880128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211916.519102:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3310:x1875075660880128:12345-0@lo:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211916.519108:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788211916.519133:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660880384 00000100:00100000:1.0:1788211916.519133:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660880256 00000100:00100000:2.0:1788211916.519137:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660880384 00000100:00100000:1.0:1788211916.519137:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660880256 00000100:00100000:1.0:1788211916.519156:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788211916.519162:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660880256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211916.519181:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788211916.519188:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660880384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211916.519205:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660880256:12345-0@lo:400:kworker.0 Request processed in 43us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211916.519211:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788211916.519224:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660880384:12345-0@lo:400:kworker.0 Request processed in 38us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211916.519229:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788211916.519411:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788211916.519427:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660880384:0@lo:400:kworker.0 00000100:00100000:2.0:1788211916.519443:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660880000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788211916.519453:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788211916.519460:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660880896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211916.519485:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211916.519576:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660880512 00000100:00100000:3.0:1788211916.519578:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660880128:0@lo:400:kworker.0 00000100:00100000:1.0:1788211916.519581:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660880512 00000100:00100000:3.0:1788211916.519591:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660880256:0@lo:400:kworker.0 00000100:00100000:1.0:1788211916.519616:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660880640 00000100:00100000:1.0:1788211916.519620:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660880640 00000100:00100000:3.0:1788211916.519628:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660880768 00000100:00100000:3.0:1788211916.519631:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660880768 00000100:00100000:1.0:1788211916.519636:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788211916.519641:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660880512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211916.519649:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788211916.519653:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660880640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211916.519679:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660880512:12345-0@lo:400:kworker.0 Request processed in 37us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211916.519680:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660880640:12345-0@lo:400:kworker.0 Request processed in 27us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211916.519686:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788211916.520274:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788211916.520298:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788211916.520307:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660880768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211916.520367:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660880768:12345-0@lo:400:kworker.0 Request processed in 63us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211916.520373:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788211916.520421:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660880896 00000100:00100000:3.0:1788211916.520425:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660880896 00000100:00100000:3.0:1788211916.520444:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788211916.520450:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660880896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211916.520471:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211916.520501:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660880896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211916.520506:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788211916.521582:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788211916.521593:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788211916.524260:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660880896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211916.524281:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660880512:0@lo:400:kworker.0 00000100:00100000:3.0:1788211916.525209:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660880768:0@lo:400:kworker.0 00000100:00100000:3.0:1788211916.525227:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660880640:0@lo:400:kworker.0 00000001:00100000:1.0:1788211916.572675:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdc55821-3eda-44a9-a166-1b5bcc681382 00000001:00100000:1.0:1788211916.572687:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8710d9ba-217c-48be-aa23-80b8773d543b 00000001:00100000:2.0:1788211916.582205:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdc55821-3eda-44a9-a166-1b5bcc681382 00000001:00100000:2.0:1788211916.582223:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8710d9ba-217c-48be-aa23-80b8773d543b 00000001:00100000:2.0:1788211916.583318:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdc55821-3eda-44a9-a166-1b5bcc681382 00000001:00100000:2.0:1788211916.583442:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8710d9ba-217c-48be-aa23-80b8773d543b 00010000:00010000:0.0:1788211917.350152:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788211917.542396:0:16409:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788211918.376380:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211919.398574:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211919.578141:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211919.578233:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211919.578257:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211919.578447:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637819904 00000100:00100000:3.0:1788211919.578456:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637819904 00000100:00100000:3.0:1788211919.578597:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:3.0:1788211919.578609:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+6:2361:x1875075637819904:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211919.578681:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+6:2361:x1875075637819904:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 75us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211919.578689:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:3.0:1788211919.578778:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211919.578842:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00080000:0.0:1788211919.578878:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211919.582378:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211919.582427:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211919.583960:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637820160 00000100:00100000:2.0:1788211919.583975:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637820160 00000100:00100000:1.0:1788211919.585998:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637820416 00000100:00100000:1.0:1788211919.586014:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637820416 00000100:00080000:2.0:1788211919.586933:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788211919.587093:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637820032 00000100:00100000:1.0:1788211919.587101:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637820032 00000100:00100000:1.0:1788211919.587136:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:1.0:1788211919.587146:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8710d9ba-217c-48be-aa23-80b8773d543b+5:2361:x1875075637820160:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211919.587253:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8710d9ba-217c-48be-aa23-80b8773d543b+5:2361:x1875075637820160:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 109us (9020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211919.587261:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:1.0:1788211919.587300:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:1.0:1788211919.587307:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8710d9ba-217c-48be-aa23-80b8773d543b+5:2361:x1875075637820032:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211919.587332:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8710d9ba-217c-48be-aa23-80b8773d543b+5:2361:x1875075637820032:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (8490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211919.587355:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:1.0:1788211919.587403:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:1.0:1788211919.587409:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2361:x1875075637820416:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211919.587436:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2361:x1875075637820416:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (9178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211919.587442:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:2.0:1788211919.587531:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637820544 00000100:00100000:2.0:1788211919.587538:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637820544 00000100:00100000:2.0:1788211919.587564:0:15617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:2.0:1788211919.587570:0:15617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2361:x1875075637820544:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211919.587593:0:15617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2361:x1875075637820544:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 24us (5166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211919.587598:0:15617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00080000:2.0:1788211919.587609:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788211919.587612:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788211919.588529:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637819776 00000100:00100000:3.0:1788211919.588539:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637819776 00000100:00100000:3.0:1788211919.588591:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 105 00000100:00100000:3.0:1788211919.588600:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+13:2361:x1875075637819776:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211919.588642:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+13:2361:x1875075637819776:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 44us (9863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211919.588649:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 105 00000100:00100000:3.0:1788211919.588698:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637820288 00000100:00100000:3.0:1788211919.588713:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637820288 00000100:00100000:3.0:1788211919.588758:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:3.0:1788211919.588764:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2361:x1875075637820288:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211919.588792:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2361:x1875075637820288:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (6425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211919.588799:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00080000:2.0:1788211919.588975:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788211920.424652:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788211920.839873:0:16556:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe397c5130 20000000:00000080:1.0:1788211920.839900:0:16556:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8abec6bd2800 uarg=0000000000000000 20000000:01000000:1.0:1788211920.839947:0:16556:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788211920.839956:0:16556:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788211920.839962:0:16556:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788211920.841444:0:16557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788211920.841616:0:16556:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788211920.849019:0:16556:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788211920.849051:0:16556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.849081:0:16556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abff63c6a00/0x2afbce82f55a663a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6633 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.849090:0:16556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abff63c6c00/0x2afbce82f55a6687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6680 expref: 18 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.849097:0:16556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abec6063800/0x2afbce82f55a67c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a67bb expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.849107:0:16556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a68e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c09 expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.849134:0:16556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a6919 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c6b expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.849141:0:16556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.849587:0:16556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a6919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c6b expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.849604:0:16556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a6919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c6b expref: 12 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211920.849620:0:16556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16556:1875075660881024:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211920.850138:0:16556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a68e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c09 expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.850149:0:16556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a68e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c09 expref: 12 pid: 14431 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211920.850158:0:16556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16556:1875075660881152:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211920.850215:0:16556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abec6063800/0x2afbce82f55a67c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a67bb expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.850224:0:16556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abec6063800/0x2afbce82f55a67c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a67bb expref: 18 pid: 14430 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211920.850233:0:16556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16556:1875075660881280:0@lo:104: 00000100:00100000:1.0:1788211920.850286:0:16556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788211920.850346:0:16556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abff63c6c00/0x2afbce82f55a6687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a6680 expref: 18 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.850354:0:16556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abff63c6c00/0x2afbce82f55a6687 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a6680 expref: 18 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211920.850362:0:16556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16556:1875075660881408:0@lo:104: 00000100:00100000:1.0:1788211920.850386:0:16556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211920.850417:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660881280 00000100:00100000:1.0:1788211920.850425:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660881280 00000100:00100000:1.0:1788211920.850467:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660881408 00000100:00100000:1.0:1788211920.850474:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660881408 00000100:00100000:1.0:1788211920.850490:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788211920.850499:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+4:16556:x1875075660881280:12345-0@lo:104: 00010000:00010000:1.0:1788211920.850510:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a67c2 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.850557:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788211920.850563:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+4:16556:x1875075660881280:12345-0@lo:104: Request processed in 66us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211920.850570:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788211920.850588:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788211920.850593:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+3:16556:x1875075660881408:12345-0@lo:104: 00010000:00010000:1.0:1788211920.850600:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6687 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211920.851889:0:16556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abff63c6a00/0x2afbce82f55a663a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a6633 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211920.851905:0:16556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abff63c6a00/0x2afbce82f55a663a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a6633 expref: 18 pid: 14430 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211920.851917:0:16556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca879500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16556:1875075660881536:0@lo:104: 00000100:00100000:0.0:1788211920.851970:0:16556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211920.852015:0:14421:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788211920.852024:0:14421:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788211920.852029:0:14421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1788211920.852073:0:16556:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe477cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788211920.852099:0:16556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16556:1875075660881280:0@lo:104: 00000100:00100000:0.0:1788211920.852109:0:16556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16556:1875075660881408:0@lo:104: 00010000:00010000:1.0:1788211920.852267:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788211920.852277:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+3:16556:x1875075660881408:12345-0@lo:104: Request processed in 1682us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211920.852295:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788211920.852320:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660881536 00000100:00100000:1.0:1788211920.852326:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660881536 00000100:00100000:1.0:1788211920.852353:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788211920.852360:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00133c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+3:16556:x1875075660881536:12345-0@lo:104: 00010000:00010000:1.0:1788211920.852372:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a663a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.852420:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788211920.852426:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00133c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+3:16556:x1875075660881536:12345-0@lo:104: Request processed in 67us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211920.852432:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788211920.852471:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788211920.852478:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a67c2 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.852486:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd200 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788211920.852490:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a67c2 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.852499:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a67c2 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788211920.852507:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a67c2 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211920.852512:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788211920.852541:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a67c2 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.852557:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788211920.852576:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a67c2 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.852583:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfca8cd200/0x2afbce82f55a67bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a67c2 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.852595:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788211920.852598:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6687 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.852604:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c7c00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788211920.852607:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a6687 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.852614:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a6687 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788211920.852620:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a6687 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211920.852625:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788211920.852638:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6687 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.852643:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788211920.852659:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6687 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.852665:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abff63c7c00/0x2afbce82f55a6680 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6687 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211920.852815:0:16556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca879500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16556:1875075660881536:0@lo:104: 00010000:00010000:2.0:1788211920.852935:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788211920.852942:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a663a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211920.852948:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cda00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:2.0:1788211920.852951:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a663a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211920.852958:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a663a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211920.852964:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a663a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211920.852970:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788211920.852986:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a663a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211920.852992:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788211920.852999:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a663a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211920.853005:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6633 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a663a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211920.853014:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211920.853016:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211920.853018:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211920.853250:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211920.853372:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211920.853385:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660881664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211920.853430:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788211920.854040:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211920.854042:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211920.854044:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211920.854072:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660881792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788211920.854106:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211920.854139:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788211920.854145:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660881920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788211920.854189:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211920.854221:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660881664 00000100:00100000:1.0:1788211920.854226:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660881664 00010000:00010000:1.0:1788211920.854252:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abec6063800/0x2afbce82f55a67c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a67bb expref: 19 pid: 14430 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211920.854283:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660881792 00000100:00100000:1.0:1788211920.854286:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660881792 00010000:00010000:1.0:1788211920.854295:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abff63c6c00/0x2afbce82f55a6687 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6680 expref: 20 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211920.854303:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660881920 00000100:00100000:1.0:1788211920.854305:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660881920 00010000:00010000:1.0:1788211920.854313:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abff63c6a00/0x2afbce82f55a663a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6633 expref: 21 pid: 14430 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211920.854325:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788211920.854332:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05b7e8c1-59a4-46a9-9396-986dc762646c+21:3308:x1875075660881664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788211920.854343:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211920.854348:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abec6063800/0x2afbce82f55a67c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a67bb expref: 21 pid: 14430 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.854370:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abec6063800/0x2afbce82f55a67c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a67bb expref: 21 pid: 14430 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.854385:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6063800/0x2afbce82f55a67c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a67bb expref: 21 pid: 14430 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.854398:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211920.854430:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05b7e8c1-59a4-46a9-9396-986dc762646c+20:3308:x1875075660881664:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211920.854437:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788211920.854453:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788211920.854458:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3310:x1875075660881792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788211920.854466:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211920.854470:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abff63c6c00/0x2afbce82f55a6687 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6680 expref: 19 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.854476:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abff63c6c00/0x2afbce82f55a6687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a6680 expref: 19 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.854485:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abff63c6c00/0x2afbce82f55a6687 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a6680 expref: 19 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.854493:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211920.854516:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05b7e8c1-59a4-46a9-9396-986dc762646c+18:3310:x1875075660881792:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211920.854521:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788211920.854531:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788211920.854536:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffe6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05b7e8c1-59a4-46a9-9396-986dc762646c+17:3310:x1875075660881920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788211920.854549:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211920.854553:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abff63c6a00/0x2afbce82f55a663a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6633 expref: 17 pid: 14430 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.854561:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abff63c6a00/0x2afbce82f55a663a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a6633 expref: 17 pid: 14430 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.854570:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abff63c6a00/0x2afbce82f55a663a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a6633 expref: 17 pid: 14430 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211920.854577:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211920.854597:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffe6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05b7e8c1-59a4-46a9-9396-986dc762646c+16:3310:x1875075660881920:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211920.854603:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788211920.854663:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660881664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788211920.855154:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660881920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788211920.855163:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660881792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788211920.864321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211920.864431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211920.864574:0:16556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16556:1875075660881024:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211920.864587:0:16556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16556:1875075660881152:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211920.864628:0:16556:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211920.864719:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637820672 00000100:00100000:3.0:1788211920.864727:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637820672 00010000:00010000:3.0:1788211920.864774:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a6919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c6b expref: 13 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211920.864798:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637820800 00000100:00100000:3.0:1788211920.864801:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637820800 00010000:00010000:3.0:1788211920.864813:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a68e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c09 expref: 14 pid: 14431 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211920.864838:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:3.0:1788211920.864953:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e558780-c9b3-4785-b2cf-98ed47205561+14:2359:x1875075637820672:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211920.864976:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211920.864983:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a6919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c6b expref: 14 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.864995:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a6919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c6b expref: 14 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865012:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37a600/0x2afbce82f55a6919 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c6b expref: 14 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865028:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211920.865081:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e558780-c9b3-4785-b2cf-98ed47205561+13:2359:x1875075637820672:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 234us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211920.865089:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:3.0:1788211920.865109:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1788211920.865116:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e558780-c9b3-4785-b2cf-98ed47205561+12:2359:x1875075637820800:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211920.865124:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211920.865130:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a68e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c09 expref: 12 pid: 14431 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865139:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a68e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c09 expref: 12 pid: 14431 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865150:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37ac00/0x2afbce82f55a68e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c09 expref: 12 pid: 14431 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865161:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865205:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865220:0:14423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865228:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865234:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865240:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865246:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211920.865251:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865268:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865281:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211920.865292:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211920.865312:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e558780-c9b3-4785-b2cf-98ed47205561+11:2359:x1875075637820800:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 196us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211920.865319:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00010000:00010000:0.0:1788211920.865453:0:16556:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211920.865462:0:16556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211920.865468:0:16556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b07400/0x2afbce82f55a6943 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211921.446672:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211921.639859:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660882304:0@lo:400:kworker.0 00000100:00100000:3.0:1788211921.639954:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211921.640015:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788211921.640021:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660882432:0@lo:400:kworker.0 00000100:00100000:3.0:1788211921.640044:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211921.640080:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660882304 00000100:00100000:3.0:1788211921.640087:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660882304 00000100:00100000:3.0:1788211921.640130:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660882432 00000100:00100000:3.0:1788211921.640133:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660882432 00000100:00100000:3.0:1788211921.640163:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788211921.640193:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660882304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211921.640260:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660882304:12345-0@lo:400:kworker.0 Request processed in 67us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211921.640267:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788211921.640284:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788211921.640291:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660882432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211921.640317:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660882432:12345-0@lo:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211921.640323:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788211921.640366:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660882432:0@lo:400:kworker.0 00000100:00100000:3.0:1788211921.640377:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660882304:0@lo:400:kworker.0 00000100:00100000:0.0:1788211921.640462:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660882048:0@lo:400:kworker.0 00000100:00100000:0.0:1788211921.640497:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211921.640532:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660882560:0@lo:400:kworker.0 00000100:00100000:0.0:1788211921.640553:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211921.640573:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211921.640579:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660882176:0@lo:400:kworker.0 00000100:00100000:0.0:1788211921.640609:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211921.640634:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660882560 00000100:00100000:0.0:1788211921.640638:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660882560 00000100:00100000:0.0:1788211921.640665:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788211921.640671:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660882560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211921.640705:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660882560:12345-0@lo:400:kworker.0 Request processed in 34us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211921.640712:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788211921.640735:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660882048 00000100:00100000:0.0:1788211921.640738:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660882048 00000100:00100000:0.0:1788211921.640761:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660882176 00000100:00100000:0.0:1788211921.640764:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660882176 00000100:00100000:0.0:1788211921.640785:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788211921.640792:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660882048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211921.640820:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660882048:12345-0@lo:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211921.640826:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788211921.640836:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788211921.640842:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660882176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211921.640869:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660882176:12345-0@lo:400:kworker.0 Request processed in 27us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211921.640874:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788211921.640917:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660882176:0@lo:400:kworker.0 00000100:00100000:0.0:1788211921.640925:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660882048:0@lo:400:kworker.0 00000100:00100000:0.0:1788211921.640932:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660882560:0@lo:400:kworker.0 00000100:00080000:2.0:1788211921.641273:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788211921.641278:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788211921.641281:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211921.641973:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211921.641996:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660882688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211921.642039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211921.642078:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660882688 00000100:00100000:0.0:1788211921.642084:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660882688 00000100:00100000:0.0:1788211921.642123:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788211921.642129:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660882688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788211921.642155:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788211921.642219:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660882688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211921.642226:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788211921.642284:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660882688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788211921.661541:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffe092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660882816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211921.661622:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211921.661712:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660882816 00000100:00100000:3.0:1788211921.661720:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660882816 00000100:00100000:3.0:1788211921.661765:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788211921.661774:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660882816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211921.661828:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211921.661879:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660882816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211921.661886:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788211921.661936:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffe092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660882816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211922.009598:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211922.009684:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637820928 00000100:00100000:0.0:1788211922.009696:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637820928 00000100:00100000:0.0:1788211922.009767:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 106 00000100:00100000:0.0:1788211922.009780:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef994850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+11:13780:x1875075637820928:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788211922.009800:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211922.009821:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfca8cd800/0x2afbce82f55a694a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5c9c expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211922.009848:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfca8cd800/0x2afbce82f55a694a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c9c expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211922.009860:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfca8cd800/0x2afbce82f55a694a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c9c expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211922.009870:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd800, rc 0) 00000100:00100000:0.0:1788211922.013834:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef994850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+12:13780:x1875075637820928:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 4039us (4228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211922.013859:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 106 00000100:00100000:1.0:1788211922.018587:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211922.018672:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637821056 00000100:00100000:2.0:1788211922.018685:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637821056 00000100:00100000:2.0:1788211922.018753:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 107 00000100:00100000:2.0:1788211922.018766:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+12:13780:x1875075637821056:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211922.019109:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+12:13780:x1875075637821056:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 346us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211922.019131:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 107 00000100:00100000:2.0:1788211922.021959:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211922.021999:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637821184 00000100:00100000:2.0:1788211922.022010:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637821184 00000100:00100000:2.0:1788211922.022058:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 108 00000100:00100000:2.0:1788211922.022069:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+12:13780:x1875075637821184:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788211922.023442:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+12:13780:x1875075637821184:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 1370us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211922.023455:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 108 00000100:00100000:3.0:1788211922.037910:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211922.039310:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637821312 00000100:00100000:1.0:1788211922.039322:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637821312 00000100:00100000:1.0:1788211922.039415:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 109 00000100:00100000:1.0:1788211922.039426:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+12:13780:x1875075637821312:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211922.039444:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211922.039463:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b07200/0x2afbce82f55a6951 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ca3 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211922.039495:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b07200/0x2afbce82f55a6951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ca3 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211922.039513:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b07200/0x2afbce82f55a6951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ca3 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211922.039524:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07200, rc 0) 00000100:00100000:1.0:1788211922.039605:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+13:13780:x1875075637821312:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 180us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211922.039612:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 109 00000100:00100000:1.0:1788211922.046451:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211922.051367:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637821440 00000100:00100000:2.0:1788211922.051395:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637821440 00000100:00100000:2.0:1788211922.051497:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 110 00000100:00100000:2.0:1788211922.051512:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+13:13780:x1875075637821440:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788211922.054218:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+13:13780:x1875075637821440:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 2698us (7771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211922.054257:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 110 00000100:00100000:2.0:1788211922.058097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211922.058280:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637821568 00000100:00100000:1.0:1788211922.058294:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637821568 00000100:00100000:1.0:1788211922.058348:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 111 00000100:00100000:1.0:1788211922.058359:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+13:13780:x1875075637821568:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788211922.058679:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+13:13780:x1875075637821568:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 320us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211922.058689:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 111 10000000:01000000:0.0:1788211922.342815:0:14434:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788211922.342898:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfef94e000 from 10 10000000:01000000:0.0:1788211922.342906:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788211922.342972:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211922.342987:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211922.343002:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211922.343032:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfca878e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660882944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788211922.343103:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211922.343162:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6631300 going to sleep for 11 seconds 00000100:00100000:1.0:1788211922.343353:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660882944 00000100:00100000:1.0:1788211922.343366:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660882944 00000100:00100000:1.0:1788211922.343428:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788211922.343440:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+16:14434:x1875075660882944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211922.343456:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211922.343472:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a695f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6958 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211922.343503:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a695f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6958 expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211922.343529:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a695f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6958 expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211922.343541:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06600, rc 0) 00000100:00100000:1.0:1788211922.343593:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+17:14434:x1875075660882944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211922.343601:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788211922.343686:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfca878e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660882944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211922.343703:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211922.343713:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211922.344100:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211922.344138:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211922.344221:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe477c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788211922.344397:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660883072 00000100:00100000:0.0:1788211922.344403:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660883072 00000100:00100000:0.0:1788211922.344430:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788211922.344437:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+17:14434:x1875075660883072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788211922.344899:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+17:14434:x1875075660883072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 461us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211922.344908:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788211922.346343:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211922.346410:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788211922.346473:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211922.346521:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe477c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788211922.346546:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660883200 00000100:00100000:1.0:1788211922.346553:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660883200 00000100:00100000:1.0:1788211922.346613:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788211922.346623:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+17:14434:x1875075660883200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788211922.347051:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+17:14434:x1875075660883200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 428us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211922.347060:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788211922.347122:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788211922.348148:0:16617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788211922.348286:0:14434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788211922.348310:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788211922.348321:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211922.348338:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211922.348347:0:14434:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788211922.348350:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abec584a000 from 10 10000000:01000000:3.0:1788211922.348353:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788211922.348386:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211922.348395:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211922.348404:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211922.348425:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788211922.348477:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211922.348514:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc2cd5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788211922.348532:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660883328 00000100:00100000:3.0:1788211922.348539:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660883328 00000100:00100000:3.0:1788211922.348576:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788211922.348585:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+17:14434:x1875075660883328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788211922.348597:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211922.348610:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a696d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6966 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211922.348637:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a696d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6966 expref: 18 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211922.348648:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a696d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6966 expref: 18 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211922.348657:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062a00, rc 0) 00000100:00100000:3.0:1788211922.348758:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+18:14434:x1875075660883328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211922.348765:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788211922.348806:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788211922.348819:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211922.348828:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211922.348877:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211922.348903:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211922.349093:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc2cd5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788211922.349142:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660883456 00000100:00100000:1.0:1788211922.349147:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660883456 00000100:00100000:1.0:1788211922.349198:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788211922.349207:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+18:14434:x1875075660883456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211922.349462:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+18:14434:x1875075660883456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211922.349470:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788211922.349765:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788211922.349797:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788211922.349835:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211922.349870:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc2cd5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788211922.349913:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660883584 00000100:00100000:1.0:1788211922.349917:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660883584 00000100:00100000:1.0:1788211922.349983:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788211922.349991:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef995c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+18:14434:x1875075660883584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788211922.350147:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef995c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+18:14434:x1875075660883584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211922.350155:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788211922.355656:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788211922.356734:0:16619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788211922.356904:0:14434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788211922.356930:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788211922.356946:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211922.356960:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211922.356972:0:14434:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788211922.356976:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ac00108a000 from 10 10000000:01000000:3.0:1788211922.356979:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788211922.357029:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211922.357037:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211922.357048:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211922.357071:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788211922.357152:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211922.357223:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc2cd5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788211922.358304:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660883712 00000100:00100000:1.0:1788211922.358318:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660883712 00000100:00100000:1.0:1788211922.358387:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788211922.358398:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+18:14434:x1875075660883712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211922.358423:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211922.358440:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a697b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6974 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211922.358467:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a697b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6974 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211922.358478:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a697b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6974 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211922.358487:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06800, rc 0) 00000100:00100000:1.0:1788211922.358552:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:14434:x1875075660883712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211922.358559:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788211922.358613:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211922.358631:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211922.358640:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211922.358709:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211922.358738:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211922.358767:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4b933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211922.358780:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660883840 00000100:00100000:1.0:1788211922.358783:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660883840 00000100:00100000:1.0:1788211922.358805:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788211922.358811:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:14434:x1875075660883840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211922.359092:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:14434:x1875075660883840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211922.359100:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788211922.359133:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788211922.359159:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788211922.363087:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211922.363140:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4b933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211922.365116:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660883968 00000100:00100000:0.0:1788211922.365128:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660883968 00000100:00100000:0.0:1788211922.365203:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788211922.365214:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00121a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:14434:x1875075660883968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788211922.365517:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00121a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:14434:x1875075660883968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 303us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211922.365534:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788211922.367287:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05b7e8c1-59a4-46a9-9396-986dc762646c:14434:1875075660883968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788211922.370446:0:16620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788211922.371973:0:14434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788211922.372004:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788211922.372015:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211922.372027:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211922.469275:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788211922.919154:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788211923.495385:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211924.517349:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211924.690999:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211924.691139:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637821696 00000100:00100000:0.0:1788211924.691150:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637821696 00000100:00100000:0.0:1788211924.691270:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:0.0:1788211924.691280:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+6:14439:x1875075637821696:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788211924.691301:0:15854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211924.691321:0:15854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5caa expref: -99 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.691395:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6989 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.691412:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.691424:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.691451:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6990 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.691459:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.691466:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.692532:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6997 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.692548:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6997 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.692557:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6997 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788211924.692776:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788211924.693065:0:15854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788211924.693070:0:15854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788211924.693282:0:15854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6997 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693297:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693305:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6989 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693312:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693330:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211924.693334:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693343:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6989 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693360:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:0.0:1788211924.693364:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211924.693370:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693376:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693391:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693396:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6990 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693402:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693408:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211924.693410:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693415:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6990 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693432:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8abfdb434f00) 00010000:00010000:0.0:1788211924.693434:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211924.693437:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6990 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693442:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6990 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693485:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5caa expref: 8 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693499:0:15854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6997 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5caa expref: 7 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.693507:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8abfdb434400) 00010000:00010000:0.0:1788211924.693510:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788211924.693512:0:15854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc600, rc 0) 00000100:00100000:0.0:1788211924.693715:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+7:14439:x1875075637821696:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 2433us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211924.693728:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:0.0:1788211924.707562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211924.707613:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211924.707659:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211924.707692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211924.707718:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211924.707738:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211924.707759:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211924.707807:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637822336 00000100:00100000:0.0:1788211924.707820:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637822336 00000100:00100000:0.0:1788211924.707903:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637822592 00000100:00100000:0.0:1788211924.707906:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637822592 00000100:00100000:0.0:1788211924.707919:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637822208 00000100:00100000:0.0:1788211924.707922:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637822208 00000100:00100000:0.0:1788211924.707933:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637822720 00000100:00100000:0.0:1788211924.707935:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637822720 00000100:00100000:0.0:1788211924.707952:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:0.0:1788211924.707963:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8710d9ba-217c-48be-aa23-80b8773d543b+5:2358:x1875075637822336:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211924.708058:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8710d9ba-217c-48be-aa23-80b8773d543b+5:2358:x1875075637822336:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 96us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211924.708067:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:0.0:1788211924.708092:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:0.0:1788211924.708099:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2358:x1875075637822592:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211924.708124:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2358:x1875075637822592:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211924.708130:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:0.0:1788211924.708145:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:0.0:1788211924.708151:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8710d9ba-217c-48be-aa23-80b8773d543b+5:2358:x1875075637822208:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211924.708223:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8710d9ba-217c-48be-aa23-80b8773d543b+5:2358:x1875075637822208:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 71us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211924.708229:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:0.0:1788211924.708242:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:0.0:1788211924.708248:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2358:x1875075637822720:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211924.708270:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2358:x1875075637822720:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 23us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211924.708284:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:0.0:1788211924.708311:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637821952 00000100:00100000:0.0:1788211924.708316:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637821952 00000100:00100000:0.0:1788211924.708341:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637822464 00000100:00100000:0.0:1788211924.708344:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637822464 00000100:00100000:0.0:1788211924.708367:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:0.0:1788211924.708373:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2358:x1875075637822464:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211924.708401:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2358:x1875075637822464:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211924.708408:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:0.0:1788211924.708419:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:0.0:1788211924.708425:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfca87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+7:14439:x1875075637821952:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788211924.708436:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211924.708462:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a699e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5cb1 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.708550:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a69a5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.708566:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a69a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.708580:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a69a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.708646:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a69ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.708665:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a69ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.708672:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a69ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709292:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a69b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709305:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a69b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709315:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a69b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211924.709328:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788211924.709620:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a69a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709629:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a69a5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709637:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a69a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709645:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211924.709650:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a69a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709659:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a69a5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709686:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8abfdb434400) 00010000:00010000:0.0:1788211924.709689:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211924.709695:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a69a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709702:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a69a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709717:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a69ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709724:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a69ac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709729:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a69ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709736:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211924.709739:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a69ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709745:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a69ac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709752:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8abfdb434f00) 00010000:00010000:0.0:1788211924.709754:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211924.709758:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a69ac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.709763:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a69ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211924.710367:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637822080 00000100:00100000:1.0:1788211924.710379:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637822080 00000100:00100000:1.0:1788211924.710437:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:1.0:1788211924.710448:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00121a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+13:2358:x1875075637822080:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211924.710529:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00121a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+13:2358:x1875075637822080:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 83us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211924.710538:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00080000:2.0:1788211924.713792:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788211924.713805:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788211924.713809:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788211924.716325:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a699e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cb1 expref: 10 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.716370:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a69b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cb1 expref: 9 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.716382:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfdb434500) 00010000:00010000:0.0:1788211924.716384:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211924.716388:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd000, rc 0) 00000100:00100000:0.0:1788211924.716487:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfca87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+9:14439:x1875075637821952:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 8060us (8935us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788211924.716497:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:0.0:1788211924.724516:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211924.724622:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637822848 00000100:00100000:1.0:1788211924.724637:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637822848 00000100:00100000:1.0:1788211924.724713:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:1.0:1788211924.724727:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+9:14439:x1875075637822848:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788211924.724850:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+9:14439:x1875075637822848:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 Request processed in 126us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211924.724859:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:2.0:1788211924.761285:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211924.761475:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637822976 00000100:00100000:3.0:1788211924.761486:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637822976 00000100:00100000:3.0:1788211924.761544:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:3.0:1788211924.761556:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+9:14445:x1875075637822976:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211924.761579:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211924.761602:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a69c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5cb8 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.761681:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a69c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.761698:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a69c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.761710:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a69c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.761776:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a69cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.761784:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a69cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.761792:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a69cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762217:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a69c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762225:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a69c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762243:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a69c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762249:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211924.762253:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a69c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762262:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a69c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762275:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:3.0:1788211924.762278:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211924.762282:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a69c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762287:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a69c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762299:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a69cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762305:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a69cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762311:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a69cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762316:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211924.762319:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a69cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762335:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a69cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762484:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8abfc5bbeb00) 00010000:00010000:3.0:1788211924.762487:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211924.762491:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a69cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762497:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a69cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762533:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a69c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cb8 expref: 10 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762543:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:3.0:1788211924.762545:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211924.762549:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a69c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cb8 expref: 10 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.762559:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062000, rc 0) 00000100:00100000:3.0:1788211924.762673:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+9:14445:x1875075637822976:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1119us (1404us total) trans 0 rc 301/301 00000100:00100000:3.0:1788211924.762681:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:0.0:1788211924.768989:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211924.774342:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637823104 00000100:00100000:2.0:1788211924.774362:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637823104 00000100:00100000:2.0:1788211924.774489:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:2.0:1788211924.774502:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8710d9ba-217c-48be-aa23-80b8773d543b+9:14445:x1875075637823104:12345-192.168.204.29@tcp:700:lfs.0 00000100:00100000:2.0:1788211924.774621:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8710d9ba-217c-48be-aa23-80b8773d543b+9:14445:x1875075637823104:12345-192.168.204.29@tcp:700:lfs.0 Request processed in 122us (5648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211924.774629:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:3.0:1788211924.777146:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211924.777488:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637823360 00000100:00100000:1.0:1788211924.777502:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637823360 00000100:00100000:1.0:1788211924.777585:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1788211924.777597:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+9:14445:x1875075637823360:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:1.0:1788211924.777676:0:15854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211924.777718:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a6904 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c33 expref: 9 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.777740:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:1.0:1788211924.777745:0:15854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788211924.778134:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.778149:0:15854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a693c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c95 expref: 5 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.778159:0:15854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.778248:0:15854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a693c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c95 expref: 5 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.778266:0:15854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a693c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c95 expref: 5 pid: 14438 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211924.778283:0:15854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15854:1875075660884096:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211924.778385:0:15854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8515240 going to sleep for 11 seconds 00000100:00100000:2.0:1788211924.786974:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211924.787978:0:15854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15854:1875075660884096:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211924.788007:0:15854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211924.788134:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637823488 00000100:00100000:3.0:1788211924.788141:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637823488 00010000:00010000:3.0:1788211924.788210:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a693c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c95 expref: 6 pid: 14438 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211924.788300:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:3.0:1788211924.788312:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2359:x1875075637823488:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211924.788332:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211924.788341:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a693c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c95 expref: 6 pid: 14438 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.788365:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a693c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c95 expref: 6 pid: 14438 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.788391:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a693c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c95 expref: 6 pid: 14438 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.788408:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:3.0:1788211924.788414:0:14423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.788423:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.788430:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.788458:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211924.788531:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2359:x1875075637823488:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 221us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211924.788538:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00010000:00010000:1.0:1788211924.788592:0:15854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.789358:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.789390:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a69dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.789402:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a69dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.789411:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a69dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211924.790945:0:15854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788211924.790965:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.790975:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.790983:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.790989:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211924.790994:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.791002:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.791029:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:1.0:1788211924.791032:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211924.791037:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211924.791043:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a69d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788211924.791061:0:15854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a15d2d8 reply state 0000000085cb533a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a69dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211924.791070:0:15854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788211924.791239:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+10:14445:x1875075637823360:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 13639us (14096us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788211924.791249:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00010000:00010000:3.0:1788211924.800869:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a69dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.800931:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a69dd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.800940:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a69dd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.800946:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211924.800952:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a69dd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.800961:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a69dd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.800994:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8abfc37ecc00) 00010000:00010000:3.0:1788211924.800997:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211924.801003:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a69dd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.801010:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06400/0x2afbce82f55a69dd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211924.895137:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211924.895499:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637823616 00000100:00100000:0.0:1788211924.895511:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637823616 00000100:00100000:0.0:1788211924.895717:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:0.0:1788211924.895732:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+9:14453:x1875075637823616:12345-192.168.204.29@tcp:101:lctl.0 00010000:00010000:0.0:1788211924.895759:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211924.895784:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a69e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5cbf expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.895859:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a69eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.895876:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a69eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.895909:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a69eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211924.895994:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788211924.895998:0:14439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1788211924.896045:0:14439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a69eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.896075:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a69e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cbf expref: 11 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.896096:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a69eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cbf expref: 10 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.896105:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434f00) 00010000:00010000:0.0:1788211924.896107:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788211924.896112:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc000, rc 0) 00000100:00100000:0.0:1788211924.896240:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+10:14453:x1875075637823616:12345-192.168.204.29@tcp:101:lctl.0 Request processed in 513us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211924.896248:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:2.0:1788211924.950646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211924.950873:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637823744 00000100:00100000:3.0:1788211924.950888:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637823744 00000100:00100000:3.0:1788211924.950972:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:3.0:1788211924.950986:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+5:14454:x1875075637823744:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211924.951008:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211924.951028:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a69f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5cc6 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.951114:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a69f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.951128:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a69f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.951137:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a69f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211924.951280:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788211924.951284:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211924.951311:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a69f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.951341:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a69f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cc6 expref: 7 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.951363:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a69f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cc6 expref: 6 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.951373:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434f00) 00010000:00010000:3.0:1788211924.951376:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788211924.951381:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6062000, rc 0) 00000100:00100000:3.0:1788211924.951467:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+6:14454:x1875075637823744:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 485us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211924.951473:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1788211924.954976:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211924.955061:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637823872 00000100:00100000:3.0:1788211924.955083:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637823872 00000100:00100000:3.0:1788211924.955158:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:3.0:1788211924.955197:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+6:14454:x1875075637823872:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211924.955805:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211924.955907:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6a00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ccd expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.955971:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6a07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.955984:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6a07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.955994:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6a07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.956006:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.956013:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.956018:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.956111:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a15 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.956117:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.956123:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211924.957162:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788211924.957205:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211924.957327:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957491:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6a07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957501:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6a07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957508:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6a07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957514:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211924.957519:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6a07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957526:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6a07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957541:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434f00) 00010000:00010000:3.0:1788211924.957544:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211924.957549:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6a07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957555:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6a07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957572:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957788:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957793:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957797:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211924.957800:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957806:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957813:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8abfc5bbeb00) 00010000:00010000:3.0:1788211924.957816:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211924.957818:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.957824:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.958005:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6a00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ccd expref: 8 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.958021:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ccd expref: 7 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.958029:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8abfc5bbe300) 00010000:00010000:3.0:1788211924.958032:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788211924.958041:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063600, rc 0) 00000100:00100000:3.0:1788211924.958204:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+7:14454:x1875075637823872:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3034us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211924.958224:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:2.0:1788211924.964006:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211924.964078:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637824128 00000100:00100000:3.0:1788211924.964089:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637824128 00000100:00100000:3.0:1788211924.964143:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:3.0:1788211924.964152:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+7:14454:x1875075637824128:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211924.964311:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211924.964334:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6a1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5cd4 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211924.964493:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788211924.964777:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6a1c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cd4 expref: 9 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.964793:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434f00) 00010000:00010000:3.0:1788211924.964795:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788211924.964800:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6a1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cd4 expref: 9 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.964814:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063c00, rc 0) 00000100:00100000:3.0:1788211924.964881:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+8:14454:x1875075637824128:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 730us (884us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788211924.964889:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00000040:00080000:1.0:1788211924.966495:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788211924.970029:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211924.970128:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637824384 00000100:00100000:0.0:1788211924.970138:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637824384 00000100:00100000:0.0:1788211924.970247:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:0.0:1788211924.970257:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+8:14454:x1875075637824384:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:0.0:1788211924.970309:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211924.970335:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a15 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ccd expref: 8 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.970386:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8abfc5bbe300) 00010000:00010000:0.0:1788211924.970396:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788211924.970421:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6a2a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.970433:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6a2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.970442:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6a2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788211924.970836:0:14439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029f8edaa reply state 000000008714f26f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6a2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211924.970847:0:14439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788211924.970862:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1788211924.971047:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+9:14454:x1875075637824384:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 791us (1026us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788211924.971054:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 24 00010000:00010000:0.0:1788211924.974745:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6a2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.974763:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6a2a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.974771:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6a2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.974777:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211924.974782:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6a2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.974803:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6a2a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.974820:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8abfdb434900) 00010000:00010000:0.0:1788211924.974823:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788211924.974828:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6a2a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211924.974835:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6a2a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211924.975157:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211924.975373:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637824640 00000100:00100000:1.0:1788211924.975383:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637824640 00000100:00100000:1.0:1788211924.975430:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:1.0:1788211924.975441:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+8:14454:x1875075637824640:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1788211924.975733:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+9:14454:x1875075637824640:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 292us (580us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788211924.975740:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:2.0:1788211924.978958:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211924.979063:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637824896 00000100:00100000:3.0:1788211924.979073:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637824896 00000100:00100000:3.0:1788211924.979220:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:3.0:1788211924.979244:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+9:14454:x1875075637824896:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211924.979267:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211924.979286:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6a31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5cdb expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979356:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6a38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979369:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6a38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979379:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6a38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979394:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979400:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979406:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211924.979529:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788211924.979618:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6a38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979626:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6a38 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979633:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6a38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979651:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211924.979655:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6a38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979663:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6a38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979676:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434f00) 00010000:00010000:3.0:1788211924.979679:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211924.979683:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6a38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979689:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062c00/0x2afbce82f55a6a38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979703:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979708:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979713:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979718:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211924.979720:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979726:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979743:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8abfc5bbeb00) 00010000:00010000:3.0:1788211924.979746:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211924.979748:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979754:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6a3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979791:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6a31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cdb expref: 11 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979801:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434f00) 00010000:00010000:3.0:1788211924.979803:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788211924.979807:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6a31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cdb expref: 11 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.979816:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063c00, rc 0) 00000100:00100000:3.0:1788211924.979998:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+10:14454:x1875075637824896:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 755us (1049us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788211924.980005:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:2.0:1788211924.982444:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211924.982682:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637825024 00000100:00100000:3.0:1788211924.982691:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637825024 00000100:00100000:3.0:1788211924.982783:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:3.0:1788211924.982794:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+10:14454:x1875075637825024:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211924.982818:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211924.982841:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6a4d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ce2 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.982962:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a54 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.982976:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.982987:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211924.983040:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788211924.983043:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788211924.983066:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.983093:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6a4d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ce2 expref: 12 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.983108:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ce2 expref: 11 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211924.983116:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8abfc5bbe600) 00010000:00010000:3.0:1788211924.983119:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788211924.983122:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063600, rc 0) 00000100:00100000:3.0:1788211924.983247:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+11:14454:x1875075637825024:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 454us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211924.983255:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:2.0:1788211924.988956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211924.989929:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637825152 00000100:00100000:1.0:1788211924.989942:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637825152 00000100:00100000:1.0:1788211924.990039:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:1.0:1788211924.990050:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+11:14454:x1875075637825152:12345-192.168.204.29@tcp:37:lfs.0 00000100:00100000:2.0:1788211924.996207:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+11:14454:x1875075637825152:12345-192.168.204.29@tcp:37:lfs.0 Request processed in 6102us (7209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211924.996243:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:1.0:1788211924.999739:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211924.999865:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637825408 00000100:00100000:0.0:1788211924.999876:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637825408 00000100:00100000:0.0:1788211924.999939:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:0.0:1788211924.999951:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8bec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+11:14454:x1875075637825408:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1788211925.000643:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8bec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+12:14454:x1875075637825408:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 691us (909us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788211925.000654:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:2.0:1788211925.050622:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211925.050774:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637825536 00000100:00100000:1.0:1788211925.050786:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637825536 00000100:00100000:1.0:1788211925.050857:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:1.0:1788211925.050868:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+10:14460:x1875075637825536:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788211925.050893:0:15854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211925.050916:0:15854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a6a5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ce9 expref: -99 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.050985:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6a62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.050999:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6a62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051010:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6a62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051024:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6a69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051030:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6a69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051037:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6a69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051144:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07000/0x2afbce82f55a6a70 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051152:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07000/0x2afbce82f55a6a70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051231:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07000/0x2afbce82f55a6a70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211925.051270:0:15854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788211925.051273:0:15854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788211925.051318:0:15854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07000/0x2afbce82f55a6a70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051331:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6a62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051337:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6a62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051344:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6a62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051349:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06a00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211925.051353:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6a62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051361:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6a62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051373:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434f00) 00010000:00010000:1.0:1788211925.051376:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211925.051381:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6a62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051387:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6a62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051414:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6a69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051420:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6a69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051427:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6a69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051432:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211925.051435:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6a69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051441:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6a69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051464:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8abfc37ec600) 00010000:00010000:1.0:1788211925.051467:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211925.051470:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6a69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051476:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6a69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051517:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a6a5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ce9 expref: 12 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051533:0:15854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07000/0x2afbce82f55a6a70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ce9 expref: 11 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.051551:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8abfc5bbe600) 00010000:00010000:1.0:1788211925.051555:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788211925.051557:0:15854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07000, rc 0) 00000100:00100000:1.0:1788211925.051654:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+11:14460:x1875075637825536:12345-192.168.204.29@tcp:101:bash.0 Request processed in 787us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211925.051662:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:0.0:1788211925.055938:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211925.056082:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637825792 00000100:00100000:2.0:1788211925.056093:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637825792 00000100:00100000:2.0:1788211925.056152:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:2.0:1788211925.056162:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+11:14460:x1875075637825792:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1788211925.056228:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211925.056252:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a6a77 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5cf0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.056420:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.056440:0:14439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a54 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ce2 expref: 11 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.056449:0:14439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.056497:0:14439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ce2 expref: 11 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.056513:0:14439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a54 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ce2 expref: 11 pid: 14438 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211925.056529:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1875075660884224:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788211925.056721:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc2bfa540 going to sleep for 11 seconds 00000100:00100000:2.0:1788211925.060144:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211925.060261:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637825920 00000100:00100000:1.0:1788211925.060271:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637825920 00010000:00010000:1.0:1788211925.060317:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a54 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ce2 expref: 12 pid: 14438 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211925.060362:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:1.0:1788211925.060373:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+12:2358:x1875075637825920:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211925.060390:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211925.060397:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a54 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ce2 expref: 12 pid: 14438 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.060411:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a54 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ce2 expref: 12 pid: 14438 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.060436:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8abfc5bbe600) 00010000:00010000:1.0:1788211925.060443:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.060455:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.060483:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.060502:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211925.060564:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+12:2358:x1875075637825920:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 192us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211925.060573:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00010000:00010000:0.0:1788211925.061334:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063600/0x2afbce82f55a6a54 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ce2 expref: 11 pid: 14438 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211925.061361:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1875075660884224:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211925.061382:0:14439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.061391:0:14439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.061405:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.061457:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6a85 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.061469:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6a85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.061478:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6a85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.062808:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6a8c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.062828:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6a8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.062840:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6a8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211925.062856:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788211925.062892:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.062899:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.062906:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.062912:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211925.062927:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.062935:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.062949:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8abfc5bbe600) 00010000:00010000:0.0:1788211925.062952:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211925.062957:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.062964:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80600/0x2afbce82f55a6a7e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788211925.062979:0:14439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000737c94ed reply state 00000000fbf0fee3 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6a85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211925.062988:0:14439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788211925.063024:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80200/0x2afbce82f55a6a77 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf0 expref: 14 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.063038:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6a8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf0 expref: 13 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.063045:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:0.0:1788211925.063047:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788211925.063050:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc800, rc 0) 00000100:00100000:0.0:1788211925.063135:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+14:14460:x1875075637825792:12345-192.168.204.29@tcp:101:bash.0 Request processed in 6974us (7211us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788211925.063144:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 28 00010000:00010000:3.0:1788211925.071800:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6a85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.071842:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6a85 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.071851:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6a85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.071857:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211925.071862:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6a85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.071870:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6a85 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.071888:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8abfdb434900) 00010000:00010000:3.0:1788211925.071892:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211925.071897:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6a85 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.071903:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6a85 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211925.082090:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211925.084084:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637826048 00000100:00100000:1.0:1788211925.084101:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637826048 00000100:00100000:1.0:1788211925.084260:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:1.0:1788211925.084272:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+13:14460:x1875075637826048:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788211925.084298:0:15854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211925.084320:0:15854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a6a9a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5cf7 expref: -99 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.084592:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.084609:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.084621:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211925.084666:0:15854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788211925.084672:0:15854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788211925.084691:0:15854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.084725:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.084751:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a6a9a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf7 expref: 15 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.084771:0:15854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf7 expref: 14 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.084780:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:1.0:1788211925.084783:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788211925.084787:0:15854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07800, rc 0) 00000100:00100000:1.0:1788211925.084930:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+14:14460:x1875075637826048:12345-192.168.204.29@tcp:101:bash.0 Request processed in 660us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211925.084938:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:2.0:1788211925.088020:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211925.088144:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637826304 00000100:00100000:0.0:1788211925.088153:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637826304 00000100:00100000:0.0:1788211925.088407:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:0.0:1788211925.088421:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8710d9ba-217c-48be-aa23-80b8773d543b+14:14460:x1875075637826304:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:0.0:1788211925.089049:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8710d9ba-217c-48be-aa23-80b8773d543b+15:14460:x1875075637826304:12345-192.168.204.29@tcp:35:bash.0 Request processed in 627us (1035us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788211925.089059:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:2.0:1788211925.210043:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211925.210127:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637826560 00000100:00100000:3.0:1788211925.210137:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637826560 00000100:00100000:3.0:1788211925.210232:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:3.0:1788211925.210242:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+15:14470:x1875075637826560:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211925.210267:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211925.210289:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6aa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5cfe expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211925.210526:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788211925.210851:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6aa8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cfe expref: 17 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.210866:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434f00) 00010000:00010000:3.0:1788211925.210869:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788211925.210874:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6aa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cfe expref: 17 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.210887:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063800, rc 0) 00000100:00100000:3.0:1788211925.210949:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+16:14470:x1875075637826560:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 709us (917us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788211925.210956:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:3.0:1788211925.215089:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211925.215496:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637826816 00000100:00100000:2.0:1788211925.215507:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637826816 00000100:00100000:2.0:1788211925.215637:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:2.0:1788211925.215648:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+16:14470:x1875075637826816:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1788211925.216111:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+17:14470:x1875075637826816:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 464us (1033us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788211925.216119:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:2.0:1788211925.262584:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211925.262789:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637827072 00000100:00100000:3.0:1788211925.262803:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637827072 00000100:00100000:3.0:1788211925.262881:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:3.0:1788211925.262893:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+17:14473:x1875075637827072:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1788211925.262920:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211925.262944:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6ab6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d05 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.263051:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6abd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.263064:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6abd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.263091:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6abd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211925.263104:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788211925.263285:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6ab6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d05 expref: 20 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.263305:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6abd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d05 expref: 19 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211925.263313:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:3.0:1788211925.263316:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788211925.263321:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063800, rc 0) 00000100:00100000:3.0:1788211925.263630:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+19:14473:x1875075637827072:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 737us (1056us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788211925.263638:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:3.0:1788211925.269316:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211925.269356:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211925.269462:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637827328 00000100:00100000:1.0:1788211925.269472:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637827328 00000100:00100000:1.0:1788211925.269549:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:1.0:1788211925.269560:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8710d9ba-217c-48be-aa23-80b8773d543b+19:2358:x1875075637827328:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211925.269575:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211925.269610:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063800/0x2afbce82f55a6abd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d05 expref: 19 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.269627:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:1.0:1788211925.269632:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211925.269647:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637827200 00000100:00100000:0.0:1788211925.269651:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637827200 00000100:00100000:0.0:1788211925.269679:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:1.0:1788211925.269684:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8710d9ba-217c-48be-aa23-80b8773d543b+19:2358:x1875075637827328:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 127us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211925.269686:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+19:14473:x1875075637827200:12345-192.168.204.29@tcp:54:lfs.0 00000100:00100000:1.0:1788211925.269703:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00010000:00010000:0.0:1788211925.269737:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6acb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.269751:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6acb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.269761:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6acb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.269785:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6acb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.269793:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6acb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.269799:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6acb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.269805:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211925.269816:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6acb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.269823:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6acb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.270237:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:0.0:1788211925.270240:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788211925.270244:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6acb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.270251:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6acb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211925.274071:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+18:14473:x1875075637827200:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 4369us (4748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211925.274092:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:2.0:1788211925.282274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211925.282366:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637827584 00000100:00100000:0.0:1788211925.282377:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637827584 00000100:00100000:0.0:1788211925.282434:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:0.0:1788211925.282447:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8710d9ba-217c-48be-aa23-80b8773d543b+18:14473:x1875075637827584:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1788211925.282739:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8710d9ba-217c-48be-aa23-80b8773d543b+19:14473:x1875075637827584:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 295us (477us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788211925.282748:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00010000:00010000:2.0:1788211925.541487:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211925.606699:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211925.609494:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637827840 00000100:00100000:1.0:1788211925.609510:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637827840 00000100:00100000:1.0:1788211925.610375:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:1.0:1788211925.610393:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+19:14504:x1875075637827840:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:1.0:1788211925.610421:0:15854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211925.610443:0:15854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6ad2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d0c expref: -99 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.610552:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6ad9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.610568:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.610580:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211925.610592:0:15854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788211925.610739:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6ad2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d0c expref: 22 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.610761:0:15854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d0c expref: 21 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.610772:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:1.0:1788211925.610776:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788211925.610780:0:15854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06e00, rc 0) 00000100:00100000:1.0:1788211925.610984:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+21:14504:x1875075637827840:12345-192.168.204.29@tcp:101:cat.0 Request processed in 597us (4298us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788211925.610992:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:3.0:1788211925.617277:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211925.617435:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211925.617520:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637828096 00000100:00100000:1.0:1788211925.617532:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637828096 00000100:00100000:1.0:1788211925.617608:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:1.0:1788211925.617619:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8710d9ba-217c-48be-aa23-80b8773d543b+21:2359:x1875075637828096:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211925.617635:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211925.617660:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6ad9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d0c expref: 21 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211925.617678:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:1.0:1788211925.617683:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211925.617749:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8710d9ba-217c-48be-aa23-80b8773d543b+20:2359:x1875075637828096:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 131us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211925.617757:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:0.0:1788211925.620467:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637828224 00000100:00100000:0.0:1788211925.620490:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637828224 00000100:00100000:0.0:1788211925.620768:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:0.0:1788211925.620783:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8710d9ba-217c-48be-aa23-80b8773d543b+20:14504:x1875075637828224:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:0.0:1788211925.621257:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8710d9ba-217c-48be-aa23-80b8773d543b+21:14504:x1875075637828224:12345-192.168.204.29@tcp:35:cat.0 Request processed in 474us (3988us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788211925.621272:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1788211925.696234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211925.696356:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637828480 00000100:00100000:0.0:1788211925.696366:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637828480 00000100:00100000:0.0:1788211925.696433:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:0.0:1788211925.696445:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+21:14510:x1875075637828480:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1788211925.696472:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211925.696497:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6ae7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d13 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.696609:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6aee lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.696624:0:14438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6a8c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf0 expref: 22 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.696632:0:14438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf7 expref: 22 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.696640:0:14438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6aee lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.696675:0:14438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf7 expref: 22 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.696689:0:14438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf7 expref: 22 pid: 15854 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211925.696703:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1875075660884352:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211925.696821:0:14438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6a8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf0 expref: 22 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.696844:0:14438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6a8c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf0 expref: 22 pid: 14439 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211925.696855:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1875075660884480:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211925.696880:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104000 going to sleep for 11 seconds 00000100:00100000:3.0:1788211925.701368:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211925.701406:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211925.701517:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637828736 00000100:00100000:2.0:1788211925.701529:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637828736 00010000:00010000:2.0:1788211925.701578:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6a8c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf0 expref: 23 pid: 14439 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211925.701617:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637828608 00000100:00100000:2.0:1788211925.701620:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637828608 00010000:00010000:2.0:1788211925.701633:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf7 expref: 24 pid: 15854 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211925.701648:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1788211925.701657:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffe6d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8710d9ba-217c-48be-aa23-80b8773d543b+24:2359:x1875075637828736:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211925.701675:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211925.701700:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6a8c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf0 expref: 24 pid: 14439 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.701712:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6a8c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf0 expref: 24 pid: 14439 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.701742:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:2.0:1788211925.701747:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6aee lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.701756:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6aee lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.701763:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211925.701828:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffe6d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8710d9ba-217c-48be-aa23-80b8773d543b+24:2359:x1875075637828736:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 172us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211925.701836:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1788211925.701891:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:2.0:1788211925.701898:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe054380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8710d9ba-217c-48be-aa23-80b8773d543b+23:2359:x1875075637828608:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211925.701908:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211925.701912:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf7 expref: 23 pid: 15854 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.701923:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf7 expref: 23 pid: 15854 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.701935:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:2.0:1788211925.701940:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6aee lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.701954:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6aee lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.701961:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6aee lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.701981:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211925.702002:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe054380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8710d9ba-217c-48be-aa23-80b8773d543b+23:2359:x1875075637828608:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 103us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211925.702008:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00010000:00010000:0.0:1788211925.703059:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07800/0x2afbce82f55a6aa1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf7 expref: 22 pid: 15854 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211925.703080:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1875075660884352:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211925.703093:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6a8c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cf0 expref: 21 pid: 14439 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211925.703103:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1875075660884480:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211925.703131:0:14438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6aee lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.703142:0:14438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6aee lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.703148:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6aee lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211925.703219:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788211925.703420:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6ae7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d13 expref: 22 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.703455:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6aee lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d13 expref: 21 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.703465:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:0.0:1788211925.703469:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788211925.703482:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd400, rc 0) 00000100:00100000:0.0:1788211925.703537:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+21:14510:x1875075637828480:12345-192.168.204.29@tcp:101:dd.0 Request processed in 7095us (7314us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788211925.703546:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:3.0:1788211925.708027:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211925.708124:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637828992 00000100:00100000:0.0:1788211925.708137:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637828992 00000100:00100000:0.0:1788211925.708242:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:0.0:1788211925.708252:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+21:14510:x1875075637828992:12345-192.168.204.29@tcp:36:dd.0 00010000:00010000:0.0:1788211925.708571:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6afc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.708601:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6afc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.708613:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6afc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788211925.708664:0:14437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788211925.708700:0:14437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de3a1e78 reply state 00000000906b5653 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6afc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211925.708709:0:14437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788211925.708813:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+24:14510:x1875075637828992:12345-192.168.204.29@tcp:36:dd.0 Request processed in 561us (794us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788211925.708821:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00000020:00080000:0.0:1788211925.708826:0:14437:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788211925.710790:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6afc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.710806:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6afc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.710814:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6afc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.710820:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211925.710826:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6afc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.710844:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6afc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.710861:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:0.0:1788211925.710864:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211925.710868:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6afc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.710874:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6afc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211925.712008:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211925.714705:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637829120 00000100:00100000:2.0:1788211925.714725:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637829120 00000100:00100000:2.0:1788211925.714910:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:2.0:1788211925.714924:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+23:14510:x1875075637829120:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1788211925.714953:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211925.714977:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80000/0x2afbce82f55a6b03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d1a expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.715049:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80000/0x2afbce82f55a6b03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d1a expref: 24 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.715064:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80000/0x2afbce82f55a6b03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d1a expref: 24 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.715083:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:2.0:1788211925.715086:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788211925.715090:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80000, rc 0) 00000100:00100000:2.0:1788211925.715205:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+24:14510:x1875075637829120:12345-192.168.204.29@tcp:101:dd.0 Request processed in 284us (3202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211925.715212:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:3.0:1788211925.726325:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211925.726499:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637829376 00000100:00100000:2.0:1788211925.726512:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637829376 00000100:00100000:2.0:1788211925.726600:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:2.0:1788211925.726614:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8710d9ba-217c-48be-aa23-80b8773d543b+24:14510:x1875075637829376:12345-192.168.204.29@tcp:103:dd.0 00010000:00010000:2.0:1788211925.726634:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211925.726663:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80000/0x2afbce82f55a6b03 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d1a expref: 24 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211925.726683:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:2.0:1788211925.726689:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211925.726763:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8710d9ba-217c-48be-aa23-80b8773d543b+23:14510:x1875075637829376:12345-192.168.204.29@tcp:103:dd.0 Request processed in 152us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211925.726772:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1788211925.729693:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211925.729859:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637829504 00000100:00100000:0.0:1788211925.729873:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637829504 00000100:00100000:0.0:1788211925.729945:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:0.0:1788211925.729956:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+23:14510:x1875075637829504:12345-192.168.204.29@tcp:58:dd.0 00010000:00010000:0.0:1788211925.730102:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6b0a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.730124:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6b0a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.730138:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6b0a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788211925.733702:0:14437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788211925.734087:0:14437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788211925.734268:0:14437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788211925.734534:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+23:14510:x1875075637829504:12345-192.168.204.29@tcp:58:dd.0 Request processed in 4573us (4844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211925.734548:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:3.0:1788211925.736928:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211925.737004:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637829632 00000100:00100000:0.0:1788211925.737015:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637829632 00000100:00100000:0.0:1788211925.737069:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:0.0:1788211925.737078:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+23:14510:x1875075637829632:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1788211925.737098:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211925.737118:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6b11 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d21 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.737199:0:14438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6b0a lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.737210:0:14438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6b11 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d21 expref: 24 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.737233:0:14438:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6b0a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.737246:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6b11 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d21 expref: 24 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.737281:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:0.0:1788211925.737284:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788211925.737289:0:14438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6b11 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d21 expref: 24 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211925.737296:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd200, rc 0) 00000100:00100000:0.0:1788211925.737362:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+24:14510:x1875075637829632:12345-192.168.204.29@tcp:101:dd.0 Request processed in 285us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211925.737370:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00000040:00080000:1.0:1788211925.989700:0:14469:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788211925.989712:0:14469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788211925.989758:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788211925.989764:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788211925.989917:0:14469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14469:1875075660884608:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788211925.990119:0:14469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8515300 going to sleep for 11 seconds 00000100:00100000:3.0:1788211926.003823:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.003926:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637829760 00000100:00100000:0.0:1788211926.003941:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637829760 00000100:00100000:1.0:1788211926.004011:0:14469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14469:1875075660884608:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788211926.004024:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:0.0:1788211926.004039:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8710d9ba-217c-48be-aa23-80b8773d543b+25:14511:x1875075637829760:12345-192.168.204.29@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788211926.004130:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8710d9ba-217c-48be-aa23-80b8773d543b+24:14511:x1875075637829760:12345-192.168.204.29@tcp:900:lhsmtool_posix.0 Request processed in 95us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211926.004139:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00080000:3.0:1788211926.004333:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211926.008046:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211926.008154:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637829888 00000100:00100000:1.0:1788211926.008268:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637829888 00000100:00100000:1.0:1788211926.008381:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:1.0:1788211926.008394:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+24:14511:x1875075637829888:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788211926.008433:0:15854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788211926.008589:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+24:14511:x1875075637829888:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 185us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211926.008597:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:3.0:1788211926.021582:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.023723:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637830016 00000100:00100000:0.0:1788211926.023741:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637830016 00000100:00100000:0.0:1788211926.023824:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:0.0:1788211926.023835:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+24:14511:x1875075637830016:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788211926.023918:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6b18 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.023935:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6b18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.023971:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6b18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.023988:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b1f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.023995:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024001:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024025:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6b26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024033:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6b26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024039:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6b26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788211926.024078:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788211926.024082:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788211926.024096:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6b26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024108:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6b18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024114:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6b18 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024131:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6b18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024137:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211926.024141:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6b18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024149:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6b18 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024699:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfdb434500) 00010000:00010000:0.0:1788211926.024704:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211926.024709:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6b18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024717:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a6b18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024731:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024737:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b1f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024742:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024747:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211926.024750:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024832:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b1f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024842:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8abfdb434e00) 00010000:00010000:0.0:1788211926.024844:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211926.024847:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b1f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024852:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b1f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024867:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6b26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024873:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6b26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024878:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6b26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024883:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0031600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211926.024886:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6b26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024892:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6b26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024899:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:0.0:1788211926.024901:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211926.024904:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6b26 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.024919:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6b26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211926.025017:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+24:14511:x1875075637830016:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 Request processed in 1181us (3449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211926.025027:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:2.0:1788211926.031366:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211926.031593:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637830272 00000100:00100000:3.0:1788211926.031604:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637830272 00000100:00100000:3.0:1788211926.031662:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:3.0:1788211926.031673:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+24:14511:x1875075637830272:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788211926.031694:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211926.031714:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6b2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d28 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.031823:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6b34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.031838:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6b34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.031848:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6b34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788211926.031858:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788211926.031953:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6b34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.031961:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6b34 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.031968:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6b34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.031991:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:3.0:1788211926.031995:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6b34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.032003:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6b34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.032015:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:3.0:1788211926.032018:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788211926.032022:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6b34 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.032027:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063c00/0x2afbce82f55a6b34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.032073:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6b2d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d28 expref: 26 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.032084:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfdb434500) 00010000:00010000:3.0:1788211926.032086:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788211926.032090:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6b2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d28 expref: 26 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.032100:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063000, rc 0) 00000100:00100000:3.0:1788211926.032222:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+25:14511:x1875075637830272:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 549us (866us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788211926.032230:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:3.0:1788211926.047853:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211926.048044:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637830400 00000100:00100000:2.0:1788211926.048055:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637830400 00000100:00100000:2.0:1788211926.048116:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:2.0:1788211926.048127:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+25:14511:x1875075637830400:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788211926.048220:0:14439:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788211926.048333:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+25:14511:x1875075637830400:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 207us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211926.048341:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:0.0:1788211926.056690:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211926.057539:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637830656 00000100:00100000:3.0:1788211926.057555:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637830656 00000100:00100000:3.0:1788211926.057637:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:3.0:1788211926.057648:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+25:14511:x1875075637830656:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788211926.057669:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211926.057690:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6b42 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d2f expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788211926.058600:0:14437:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1788211926.058609:0:14437:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788211926.058660:0:14437:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788211926.059839:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81c00/0x2afbce82f55a6b49 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.059870:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81c00/0x2afbce82f55a6b49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.059881:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81c00/0x2afbce82f55a6b49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.059948:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6063000/0x2afbce82f55a6b42 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d2f expref: 28 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.059967:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81c00/0x2afbce82f55a6b49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d2f expref: 27 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.059975:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac00206ee00) 00010000:00010000:2.0:1788211926.059978:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788211926.059981:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81c00, rc 0) 00000100:00100000:2.0:1788211926.060058:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+27:14511:x1875075637830656:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 2411us (3380us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788211926.060067:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:3.0:1788211926.068652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211926.072067:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637830912 00000100:00100000:2.0:1788211926.072090:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637830912 00000100:00100000:2.0:1788211926.072244:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:2.0:1788211926.072256:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+27:14511:x1875075637830912:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788211926.072336:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211926.072369:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81c00/0x2afbce82f55a6b49 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d2f expref: 27 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.073934:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac00206ee00) 00010000:00010000:2.0:1788211926.073980:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788211926.074017:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a6b57 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074036:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a6b57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074050:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a6b57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074124:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a6b5e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x237fe053 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074132:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a6b5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x237fe053 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074138:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a6b5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x237fe053 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074265:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a6b57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074273:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a6b57 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074280:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a6b57 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074286:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211926.074291:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a6b57 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074300:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a6b57 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074503:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8abfc5bbe600) 00010000:00010000:2.0:1788211926.074509:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211926.074514:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a6b57 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074521:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a6b57 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074535:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a6b5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x237fe053 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074542:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a6b5e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x237fe053 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074548:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a6b5e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x237fe053 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074553:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211926.074556:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a6b5e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x237fe053 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074562:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a6b5e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x237fe053 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074571:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x237fe053 (ffff8ac00206ec00) 00010000:00010000:2.0:1788211926.074573:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788211926.074576:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a6b5e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x237fe053 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.074581:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a6b5e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x237fe053 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211926.075583:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+26:14511:x1875075637830912:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 3320us (6932us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788211926.075595:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:3.0:1788211926.096842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211926.096934:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637831040 00000100:00100000:1.0:1788211926.096944:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637831040 00000100:00100000:1.0:1788211926.097006:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:1.0:1788211926.097017:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+26:14511:x1875075637831040:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788211926.097050:0:15854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211926.097082:0:15854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6b65 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d36 expref: -99 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.097127:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6b6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.097141:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6b6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.097152:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6b6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.097331:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6b65 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d36 expref: 28 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.097356:0:15854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6b6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d36 expref: 27 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.097365:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8abfc37ec600) 00010000:00010000:1.0:1788211926.097368:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788211926.097372:0:15854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06a00, rc 0) 00000100:00100000:1.0:1788211926.097441:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+27:14511:x1875075637831040:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 426us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211926.097448:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:3.0:1788211926.103204:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.111027:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637831296 00000100:00100000:0.0:1788211926.111049:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637831296 00000100:00100000:1.0:1788211926.118387:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:1.0:1788211926.118407:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+27:14511:x1875075637831296:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788211926.118534:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a6b73 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.118554:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a6b73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.119811:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a6b73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788211926.125401:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1788211926.125431:0:14438:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 515431263768ns, next at 516431258064ns, rc = 0 00000004:00010000:1.0:1788211926.125561:0:14438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006862cb55 reply state 000000004d0b5cbd transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a6b73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211926.127096:0:14438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788211926.127261:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+29:14511:x1875075637831296:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 8854us (24061us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788211926.127284:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 46 00010000:00010000:2.0:1788211926.131863:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a6b73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.131881:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a6b73 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.131889:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a6b73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.131895:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07a00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788211926.131899:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a6b73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.131906:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a6b73 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.131923:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8abfc37ec600) 00010000:00010000:2.0:1788211926.131926:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788211926.131930:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a6b73 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.131935:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a6b73 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211926.138794:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211926.139141:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637831424 00000100:00100000:1.0:1788211926.139151:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637831424 00000100:00100000:1.0:1788211926.139243:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:1.0:1788211926.139252:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+28:14511:x1875075637831424:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788211926.139275:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211926.139293:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6b7a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d3d expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.139349:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6b7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d3d expref: 29 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.139362:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6b7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d3d expref: 29 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.139380:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8abfc37ec600) 00010000:00010000:1.0:1788211926.139383:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788211926.139386:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06e00, rc 0) 00000100:00100000:1.0:1788211926.139485:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+29:14511:x1875075637831424:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 234us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211926.139503:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:3.0:1788211926.149954:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.150135:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637831552 00000100:00100000:0.0:1788211926.150163:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637831552 00000100:00100000:0.0:1788211926.150278:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:0.0:1788211926.150290:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8710d9ba-217c-48be-aa23-80b8773d543b+5:2358:x1875075637831552:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788211926.150819:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788211926.150960:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8710d9ba-217c-48be-aa23-80b8773d543b+6:2358:x1875075637831552:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 670us (1014us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788211926.150969:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:2.0:1788211926.156863:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211926.156958:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637831808 00000100:00100000:1.0:1788211926.156969:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637831808 00000100:00100000:1.0:1788211926.157035:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:1.0:1788211926.157046:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+29:14511:x1875075637831808:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788211926.157339:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+30:14511:x1875075637831808:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 294us (488us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788211926.157362:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1788211926.160071:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.160202:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637832064 00000100:00100000:0.0:1788211926.160211:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637832064 00000100:00100000:0.0:1788211926.160264:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:0.0:1788211926.160274:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+30:14511:x1875075637832064:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788211926.160384:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+30:14511:x1875075637832064:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 111us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211926.160393:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:3.0:1788211926.163304:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211926.163686:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637832192 00000100:00100000:1.0:1788211926.163700:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637832192 00000100:00100000:1.0:1788211926.163757:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:1.0:1788211926.163767:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+30:14511:x1875075637832192:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788211926.163790:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788211926.163815:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a6b81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d44 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.163941:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a6b88 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.163959:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a6b88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.163972:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a6b88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788211926.164023:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788211926.164046:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a6b88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.164076:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a6b81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d44 expref: 32 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.164112:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a6b88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d44 expref: 31 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.164121:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8abfc37ec600) 00010000:00010000:1.0:1788211926.164131:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788211926.164135:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06000, rc 0) 00000100:00100000:1.0:1788211926.164407:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+31:14511:x1875075637832192:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 641us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211926.164415:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:3.0:1788211926.167492:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.167676:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637832320 00000100:00100000:0.0:1788211926.167687:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637832320 00000100:00100000:0.0:1788211926.167742:0:15617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:0.0:1788211926.167764:0:15617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8710d9ba-217c-48be-aa23-80b8773d543b+6:2359:x1875075637832320:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788211926.167780:0:15617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211926.167801:0:15617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000917eff38/0x2afbce82f55a6b8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d4b expref: -99 pid: 15617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788211926.167825:0:15617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95f2d5, blocks: 0x1 00010000:00010000:0.0:1788211926.167842:0:15617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788211926.167848:0:15617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211926.167857:0:15617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000917eff38/0x2afbce82f55a6b8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d4b expref: 7 pid: 15617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.167878:0:15617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000917eff38/0x2afbce82f55a6b8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d4b expref: 7 pid: 15617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.167890:0:15617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0031600, rc 0) 00000100:00100000:0.0:1788211926.167949:0:15617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8710d9ba-217c-48be-aa23-80b8773d543b+7:2359:x1875075637832320:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 186us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211926.167955:0:15617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:3.0:1788211926.177629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.177866:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637832576 00000100:00100000:0.0:1788211926.177878:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637832576 00000100:00100000:0.0:1788211926.177948:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:0.0:1788211926.177959:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+31:14511:x1875075637832576:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788211926.178087:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+31:14511:x1875075637832576:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 130us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211926.178103:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:3.0:1788211926.196996:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211926.197077:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637832704 00000100:00100000:1.0:1788211926.197088:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637832704 00000100:00100000:1.0:1788211926.197207:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:1.0:1788211926.197219:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+31:14511:x1875075637832704:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788211926.288308:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:3.0:1788211926.288338:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1788211926.288362:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1788211926.288370:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788211926.288661:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+21:14511:x1875075637832704:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 Request processed in 91436us (91669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211926.288673:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:2.0:1788211926.288964:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788211926.288982:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660884736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788211926.289041:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211926.289216:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660884736 00000100:00100000:0.0:1788211926.289224:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660884736 00000100:00100000:0.0:1788211926.289283:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788211926.289294:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660884736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788211926.290498:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788211926.290504:0:15119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788211926.290507:0:15119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788211926.290509:0:15119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788211925 -> 1788211925 00002000:00010000:0.0:1788211926.290512:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788211926.290718:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660884736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1421us (1672us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788211926.290728:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788211926.290841:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788211926.290884:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abfef8a5500/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788211926.290891:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660884736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788211926.298103:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.298613:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637832832 00000100:00100000:0.0:1788211926.298623:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637832832 00000100:00100000:0.0:1788211926.298685:0:15617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:0.0:1788211926.298696:0:15617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8710d9ba-217c-48be-aa23-80b8773d543b+7:2358:x1875075637832832:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788211926.298816:0:15617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8710d9ba-217c-48be-aa23-80b8773d543b+7:2358:x1875075637832832:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 Request processed in 122us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211926.298823:0:15617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:3.0:1788211926.317802:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.318072:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637833088 00000100:00100000:0.0:1788211926.318082:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637833088 00000100:00100000:0.0:1788211926.318203:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:0.0:1788211926.318216:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+14:14511:x1875075637833088:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788211926.318269:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788211926.318298:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a6b88 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d44 expref: 14 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.318340:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8abfc37ec600) 00010000:00010000:0.0:1788211926.318360:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788211926.318398:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.318412:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.318423:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788211926.319356:0:14439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005de5dddd reply state 00000000c9dffef5 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211926.319369:0:14439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788211926.319488:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+15:14511:x1875075637833088:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 1272us (1705us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788211926.319497:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 52 00010000:00010000:0.0:1788211926.324008:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.324024:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b96 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.324031:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.324038:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788211926.324045:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.324075:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b96 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.324098:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8abfc37ec600) 00010000:00010000:0.0:1788211926.324101:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788211926.324106:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b96 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.324112:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6b96 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211926.324874:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.325120:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637833216 00000100:00100000:0.0:1788211926.325133:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637833216 00000100:00100000:0.0:1788211926.325376:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:0.0:1788211926.325392:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8710d9ba-217c-48be-aa23-80b8773d543b+7:14511:x1875075637833216:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788211926.325420:0:15119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211926.325451:0:15119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d52 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.325494:0:15119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000917eff38/0x2afbce82f55a6b8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d4b expref: 8 pid: 15617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.325505:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211926.325510:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788211926.325515:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d52 expref: 8 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.325721:0:15119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000917eff38/0x2afbce82f55a6b8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d4b expref: 8 pid: 15617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.325739:0:15119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000917eff38/0x2afbce82f55a6b8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d4b expref: 8 pid: 15617 timeout: 615 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211926.325758:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15119:1875075660884864:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211926.326127:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef9bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788211926.334679:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211926.335781:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637833344 00000100:00100000:3.0:1788211926.335794:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637833344 00010000:00010000:3.0:1788211926.335874:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000917eff38/0x2afbce82f55a6b8f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d4b expref: 9 pid: 15617 timeout: 615 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211926.335920:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:3.0:1788211926.335930:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8710d9ba-217c-48be-aa23-80b8773d543b+9:2359:x1875075637833344:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211926.335944:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211926.335967:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000917eff38/0x2afbce82f55a6b8f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d4b expref: 9 pid: 15617 timeout: 615 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.335980:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000917eff38/0x2afbce82f55a6b8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d4b expref: 9 pid: 15617 timeout: 615 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.336005:0:14423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211926.336010:0:14423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211926.336018:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d52 expref: 9 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.336029:0:14423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d52 expref: 9 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.336070:0:14423:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d52 expref: 9 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211926.336086:0:14423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6460a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14423:1875075660884992:192.168.204.29@tcp:105: 00000100:00100000:3.0:1788211926.336253:0:14423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc3d623c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211926.339262:0:14423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6460a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14423:1875075660884992:192.168.204.29@tcp:105: 00010000:00010000:3.0:1788211926.339293:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211926.339367:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8710d9ba-217c-48be-aa23-80b8773d543b+9:2359:x1875075637833344:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 3437us (4696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211926.339379:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00010000:00010000:0.0:1788211926.339890:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000917eff38/0x2afbce82f55a6b8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d4b expref: 8 pid: 15617 timeout: 615 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211926.339915:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15119:1875075660884864:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211926.340129:0:15119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d52 expref: 7 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.340147:0:15119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0031a00, rc 0) 00000100:00100000:0.0:1788211926.340230:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8710d9ba-217c-48be-aa23-80b8773d543b+7:14511:x1875075637833216:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 14842us (15369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211926.340476:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:2.0:1788211926.347105:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.347282:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637833472 00000100:00100000:0.0:1788211926.347299:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637833472 00000100:00100000:0.0:1788211926.347391:0:15617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:0.0:1788211926.347402:0:15617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8710d9ba-217c-48be-aa23-80b8773d543b+7:2358:x1875075637833472:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788211926.347648:0:15617:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788211926.347652:0:15617:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788211925 00002000:00010000:0.0:1788211926.347655:0:15617:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788211924 00002000:00010000:0.0:1788211926.347657:0:15617:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788211925 -> 1788211925 00002000:00010000:0.0:1788211926.347659:0:15617:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788211926.347741:0:15617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8710d9ba-217c-48be-aa23-80b8773d543b+8:2358:x1875075637833472:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 340us (653us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788211926.347750:0:15617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:3.0:1788211926.359067:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211926.359333:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637833600 00000100:00100000:1.0:1788211926.359352:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637833600 00000100:00100000:1.0:1788211926.359452:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:1.0:1788211926.359465:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8710d9ba-217c-48be-aa23-80b8773d543b+8:2361:x1875075637833600:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788211926.359533:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.359561:0:15121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d52 expref: 8 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.359582:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211926.359588:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788211926.359593:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.359669:0:15121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d52 expref: 8 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.359685:0:15121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d52 expref: 8 pid: 15119 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211926.359704:0:15121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15121:1875075660885120:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788211926.359826:0:15121:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc2cd5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788211926.365068:0:15121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15121:1875075660885120:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788211926.365117:0:15121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211926.367832:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211926.370663:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637833728 00000100:00100000:1.0:1788211926.370679:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637833728 00010000:00010000:1.0:1788211926.370729:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d52 expref: 9 pid: 15119 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211926.370838:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:1.0:1788211926.370849:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8710d9ba-217c-48be-aa23-80b8773d543b+9:2359:x1875075637833728:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211926.370864:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211926.370888:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d52 expref: 9 pid: 15119 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.370926:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d52 expref: 9 pid: 15119 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.370953:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c714bf8/0x2afbce82f55a6b9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d52 expref: 9 pid: 15119 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.370972:0:14424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788211926.370976:0:14424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788211926.370983:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.370992:0:14424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.371037:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211926.371106:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8710d9ba-217c-48be-aa23-80b8773d543b+8:2359:x1875075637833728:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 258us (3286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211926.371114:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00010000:00010000:0.0:1788211926.371201:0:15121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.371213:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.371237:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.371247:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.371254:0:15121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.371262:0:15121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211926.371266:0:15121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.371288:0:15121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.371302:0:15121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.371309:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046eaf6f5/0x2afbce82f55a6ba4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211926.371369:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8710d9ba-217c-48be-aa23-80b8773d543b+7:2361:x1875075637833600:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 Request processed in 11907us (12316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211926.371394:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:3.0:1788211926.375390:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.375543:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637833984 00000100:00100000:0.0:1788211926.375553:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637833984 00000100:00100000:0.0:1788211926.375718:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:0.0:1788211926.375731:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+14:14511:x1875075637833984:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788211926.375824:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6bab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.375842:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6bab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.375853:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6bab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.376114:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.376132:0:15854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6b7a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d3d expref: 15 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.376568:0:15854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.376760:0:15854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6b7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d3d expref: 15 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.376776:0:15854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6b7a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d3d expref: 15 pid: 14437 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211926.376790:0:15854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15854:1875075660885248:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788211926.376904:0:15854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef9bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211926.385785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.386052:0:15854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15854:1875075660885248:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788211926.386105:0:15854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211926.386703:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637834112 00000100:00100000:1.0:1788211926.386712:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637834112 00010000:00010000:1.0:1788211926.386757:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6b7a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d3d expref: 16 pid: 14437 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211926.386803:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:1.0:1788211926.386813:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8710d9ba-217c-48be-aa23-80b8773d543b+16:2359:x1875075637834112:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788211926.386846:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211926.386853:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6b7a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d3d expref: 16 pid: 14437 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.386867:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6b7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d3d expref: 16 pid: 14437 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.386891:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6b7a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d3d expref: 16 pid: 14437 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.386907:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8abfc37ec600) 00010000:00010000:1.0:1788211926.386911:0:14423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.386921:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.386928:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.386961:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211926.387028:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8710d9ba-217c-48be-aa23-80b8773d543b+15:2359:x1875075637834112:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 215us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211926.387036:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00010000:00010000:0.0:1788211926.387519:0:15854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211926.387530:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788211926.387740:0:15854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788211926.387893:0:15854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788211926.387946:0:15854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788211926.388035:0:15854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac0010a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15854:1875075660885376:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788211926.389600:0:15854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211926.389653:0:15854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef9bfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211926.390244:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660885376 00000100:00100000:2.0:1788211926.390254:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660885376 00000100:00100000:2.0:1788211926.391485:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788211926.391501:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15854:x1875075660885376:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788211926.391636:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15854:x1875075660885376:12345-0@lo:1000:mdt00_003.0 Request processed in 141us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211926.391644:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788211926.391686:0:15854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac0010a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15854:1875075660885376:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788211926.392961:0:15854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788211926.393052:0:15854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15854:1875075660885504:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788211926.393108:0:15854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211926.393228:0:15854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc2cd5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788211926.394031:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660885504 00000100:00100000:2.0:1788211926.394046:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660885504 00000100:00100000:2.0:1788211926.394118:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211926.394140:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15854:x1875075660885504:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788211926.395952:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15854:x1875075660885504:12345-0@lo:1000:mdt00_003.0 Request processed in 1803us (2831us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788211926.395967:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788211926.397315:0:15854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15854:1875075660885504:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788211926.397546:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397558:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397566:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397571:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0030e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211926.397575:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397583:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397600:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8abfc37ec600) 00010000:00010000:1.0:1788211926.397604:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788211926.397608:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397615:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0030e00/0x2afbce82f55a6bb2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397674:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6b0a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397682:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6b0a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397688:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6b0a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397714:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211926.397717:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6b0a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397724:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6b0a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397734:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:1.0:1788211926.397736:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788211926.397744:0:15854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6b11 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d21 expref: 18 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397757:0:15854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6b11 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d21 expref: 18 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397767:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6b11 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d21 expref: 18 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.397849:0:15854:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6b11 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d21 expref: 18 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211926.397866:0:15854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15854:1875075660885632:192.168.204.29@tcp:105: 00000100:00100000:1.0:1788211926.397975:0:15854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc2cd59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211926.403641:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211926.403791:0:15854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15854:1875075660885632:192.168.204.29@tcp:105: 00010000:00010000:1.0:1788211926.403822:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6b0a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403854:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc400/0x2afbce82f55a6b0a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403887:0:15854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6bb9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403901:0:15854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6bb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403911:0:15854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6bb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403921:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6bb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403927:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6bb9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403934:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6bb9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403940:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211926.403945:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6bb9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403952:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6bb9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403963:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:1.0:1788211926.403966:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788211926.403969:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6bb9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403982:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06e00/0x2afbce82f55a6bb9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403992:0:15854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6bab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.403998:0:15854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6bab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.404003:0:15854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6bab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.404008:0:15854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0031600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788211926.404012:0:15854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6bab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.404017:0:15854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6bab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.404024:0:15854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:1.0:1788211926.404026:0:15854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788211926.404029:0:15854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6bab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.404035:0:15854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc0031600/0x2afbce82f55a6bab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211926.404325:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+18:14511:x1875075637833984:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 28595us (28942us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788211926.404336:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00000020:00080000:1.0:1788211926.404348:0:15854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788211926.404611:0:14469:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788211926.404617:0:14469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788211926.404658:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788211926.404665:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788211926.405261:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637834240 00000100:00100000:2.0:1788211926.405275:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637834240 00000100:00100000:2.0:1788211926.405342:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:2.0:1788211926.405355:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+18:14510:x1875075637834240:12345-192.168.204.29@tcp:49:dd.0 00000100:00100000:2.0:1788211926.405555:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+18:14510:x1875075637834240:12345-192.168.204.29@tcp:49:dd.0 Request processed in 201us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211926.405563:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:3.0:1788211926.412089:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211926.412310:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637834496 00000100:00100000:2.0:1788211926.412324:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637834496 00000100:00100000:2.0:1788211926.412578:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1788211926.412590:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+18:14511:x1875075637834496:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788211926.415082:0:14440:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788211926.416926:0:14440:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788211926.417010:0:14440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a6bc0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.417031:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a6bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.417046:0:14440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a6bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.417501:0:14440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a6bc0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.417517:0:14440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a6bc0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.417525:0:14440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a6bc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.417716:0:14440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788211926.417857:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+20:14511:x1875075637834496:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 5265us (5777us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788211926.417887:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000020:00080000:2.0:1788211926.417893:0:14440:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788211926.417962:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788211926.417969:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a6bc0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.417977:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788211926.417981:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a6bc0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.417988:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a6bc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.418002:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8abfc37ec600) 00010000:00010000:1.0:1788211926.418005:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788211926.418010:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a6bc0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.418016:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a6bc0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.418028:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211926.418030:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211926.418031:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211926.567507:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211926.701248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.701683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.712709:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211926.722394:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637834624 00000100:00100000:3.0:1788211926.722425:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637834624 00000100:00100000:3.0:1788211926.722657:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637834752 00000100:00100000:3.0:1788211926.722662:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637834752 00000100:00100000:2.0:1788211926.723337:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:2.0:1788211926.723356:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8710d9ba-217c-48be-aa23-80b8773d543b+8:2359:x1875075637834624:12345-192.168.204.29@tcp:4:dd.0 00000100:00100000:0.0:1788211926.723567:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.723601:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.723615:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.723629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211926.723674:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00002000:00010000:2.0:1788211926.730702:0:15127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a95f2d5, atime: 0x6a95f2d4, ctime: 0x6a95f2d5, blocks: 0x1 00010000:00010000:2.0:1788211926.730717:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6bc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.730743:0:15127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1788211926.730750:0:15127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211926.730759:0:15127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6bc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.730785:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6bc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211926.734213:0:15125:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788211926.734234:0:15125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788211926.736522:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637834880 00000100:00100000:0.0:1788211926.736540:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637834880 00000100:00100000:0.0:1788211926.736643:0:15125:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788211926.736655:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637835008 00000100:00100000:0.0:1788211926.736658:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637835008 00000100:00100000:0.0:1788211926.736673:0:15125:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788211926.736678:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637835136 00000100:00100000:0.0:1788211926.736680:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637835136 00000100:00100000:0.0:1788211926.736692:0:15125:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788211926.736698:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637835264 00000100:00100000:0.0:1788211926.736701:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637835264 00000100:00100000:0.0:1788211926.736713:0:15125:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788211926.736720:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637835520 00000100:00100000:0.0:1788211926.736723:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637835520 00000100:00100000:0.0:1788211926.736735:0:15125:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788211926.736739:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637835392 00000100:00100000:0.0:1788211926.736755:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637835392 00000100:00100000:3.0:1788211926.739376:0:16671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:3.0:1788211926.739398:0:16671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8710d9ba-217c-48be-aa23-80b8773d543b+15:2359:x1875075637834752:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:3.0:1788211926.739448:0:16671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.739474:0:16671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211926.739479:0:16671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211926.739486:0:16671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.739501:0:16671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211926.757559:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660885760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211926.757587:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660885888:0@lo:400:kworker.0 00000100:00100000:2.0:1788211926.757993:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660886016:0@lo:400:kworker.0 00000100:00100000:0.0:1788211926.761625:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211926.761732:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660886400:0@lo:400:kworker.0 00000100:00100000:0.0:1788211926.761781:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211926.762029:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660886400 00000100:00100000:0.0:1788211926.762040:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660886400 00000100:00100000:0.0:1788211926.762123:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788211926.762133:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660886400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211926.762222:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660886400:12345-0@lo:400:kworker.0 Request processed in 90us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211926.762231:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788211926.762287:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660886400:0@lo:400:kworker.0 00000100:00080000:1.0:1788211926.766851:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211926.766963:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660885888 00000100:00100000:1.0:1788211926.766980:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660885888 00000100:00100000:1.0:1788211926.767037:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788211926.767048:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac00121ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3309:x1875075660885888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211926.767192:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac00121ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3309:x1875075660885888:12345-0@lo:400:kworker.0 Request processed in 145us (5582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211926.767202:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788211926.767405:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660886144:0@lo:400:kworker.0 00000100:00100000:1.0:1788211926.769055:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660885888:0@lo:400:kworker.0 00000100:00100000:0.0:1788211926.769678:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211926.769724:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660886656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788211926.769756:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211926.769798:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660886144 00000100:00100000:0.0:1788211926.769806:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660886144 00000100:00100000:2.0:1788211926.770035:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211926.770063:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660886016 00000100:00100000:2.0:1788211926.770066:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660886016 00000100:00100000:2.0:1788211926.770679:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788211926.770692:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660886016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211926.770744:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660886016:12345-0@lo:400:kworker.0 Request processed in 56us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211926.770750:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788211926.770805:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660886016:0@lo:400:kworker.0 00000100:00100000:2.0:1788211926.770814:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660886528:0@lo:400:kworker.0 00000100:00100000:2.0:1788211926.770849:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211926.770878:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660886528 00000100:00100000:2.0:1788211926.770882:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660886528 00000100:00100000:0.0:1788211926.771030:0:15617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788211926.771039:0:15617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660886144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211926.771085:0:15617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660886144:12345-0@lo:400:kworker.0 Request processed in 48us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211926.771091:0:15617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788211926.771135:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660886144:0@lo:400:kworker.0 00000100:00100000:2.0:1788211926.771557:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788211926.771578:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660886528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211926.771642:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660886528:12345-0@lo:400:kworker.0 Request processed in 76us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211926.771649:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788211926.771688:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660886528:0@lo:400:kworker.0 00000100:00100000:2.0:1788211926.771729:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660886656 00000100:00100000:2.0:1788211926.771734:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660886656 00000100:00100000:2.0:1788211926.771760:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788211926.771765:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660886656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211926.771792:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211926.771830:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660886656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211926.771835:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788211926.771980:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788211926.771986:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788211926.772063:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660886656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211926.772275:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211926.772346:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660886272:0@lo:400:kworker.0 00000100:00100000:1.0:1788211926.772378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211926.772425:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660886272 00000100:00100000:1.0:1788211926.772429:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660886272 00000100:00100000:1.0:1788211926.772459:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788211926.772466:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660886272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211926.772504:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660886272:12345-0@lo:400:kworker.0 Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211926.772511:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788211926.772543:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660886272:0@lo:400:kworker.0 00000100:00100000:0.0:1788211926.775084:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660885760 00000100:00100000:0.0:1788211926.775097:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660885760 00000100:00100000:0.0:1788211926.775157:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788211926.775204:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875075660885760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788211926.775230:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54460416 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788211926.775322:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875075660885760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (3048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211926.775333:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788211926.775586:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abff6461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660885760:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788211926.819246:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1788211926.819267:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:3.0:1788211926.819275:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1788211926.859296:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1788211926.859583:0:15127:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1788211926.859587:0:15127:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788211925 -> 1788211926 00002000:00010000:1.0:1788211926.859590:0:15127:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788211925 -> 1788211926 00002000:00010000:1.0:1788211926.859592:0:15127:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1788211926.859607:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6bc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.859620:0:15127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6bc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.859628:0:15127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6bc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.859635:0:15127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788211926.859653:0:15127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6bc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.859662:0:15127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6bc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.859681:0:15127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6bc7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.859688:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000168b6c6f/0x2afbce82f55a6bc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211926.859771:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8710d9ba-217c-48be-aa23-80b8773d543b+15:2359:x1875075637834624:12345-192.168.204.29@tcp:4:dd.0 Request processed in 136418us (158533us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788211926.859781:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:1.0:1788211926.859812:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:1.0:1788211926.859823:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8710d9ba-217c-48be-aa23-80b8773d543b+14:2358:x1875075637834880:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:1.0:1788211926.859853:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077f5970e/0x2afbce82f55a6bd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.859864:0:15127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211926.859869:0:15127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788211926.859875:0:15127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077f5970e/0x2afbce82f55a6bd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211926.859887:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077f5970e/0x2afbce82f55a6bd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788211926.860111:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00010000:00010000:2.0:1788211926.860716:0:16671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.860727:0:16671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.860735:0:16671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.860741:0:16671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211926.860745:0:16671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.860753:0:16671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.860768:0:16671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.860776:0:16671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211926.860840:0:16671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8710d9ba-217c-48be-aa23-80b8773d543b+12:2359:x1875075637834752:12345-192.168.204.29@tcp:4:dd.0 Request processed in 121448us (159156us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788211926.860849:0:16671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:2.0:1788211926.860871:0:16671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:2.0:1788211926.860888:0:16671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8710d9ba-217c-48be-aa23-80b8773d543b+11:2358:x1875075637835008:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:2.0:1788211926.860911:0:16671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6bdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.860919:0:16671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211926.860922:0:16671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211926.860927:0:16671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6bdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.860936:0:16671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6bdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788211926.923090:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1788211926.923228:0:16671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:2.0:1788211926.923234:0:16671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:2.0:1788211926.923249:0:16671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6bdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.923263:0:16671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6bdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.923271:0:16671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6bdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.923279:0:16671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788211926.923284:0:16671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6bdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.923323:0:16671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6bdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.923344:0:16671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6bdc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.923351:0:16671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a1a3c8a/0x2afbce82f55a6bdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211926.923444:0:16671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8710d9ba-217c-48be-aa23-80b8773d543b+11:2358:x1875075637835008:12345-192.168.204.29@tcp:4:dd.0 Request processed in 62552us (199872us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788211926.923455:0:16671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:2.0:1788211926.923487:0:16671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:2.0:1788211926.923500:0:16671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8710d9ba-217c-48be-aa23-80b8773d543b+10:2359:x1875075637835136:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:2.0:1788211926.923532:0:16671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6be3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.923545:0:16671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211926.923549:0:16671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788211926.923555:0:16671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6be3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211926.923681:0:16671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6be3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.930617:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077f5970e/0x2afbce82f55a6bd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.930638:0:15127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077f5970e/0x2afbce82f55a6bd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.930647:0:15127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077f5970e/0x2afbce82f55a6bd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.930655:0:15127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211926.930660:0:15127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077f5970e/0x2afbce82f55a6bd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.930669:0:15127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077f5970e/0x2afbce82f55a6bd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.930691:0:15127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077f5970e/0x2afbce82f55a6bd5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.930699:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077f5970e/0x2afbce82f55a6bd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211926.930803:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8710d9ba-217c-48be-aa23-80b8773d543b+10:2358:x1875075637834880:12345-192.168.204.29@tcp:4:dd.0 Request processed in 70978us (218102us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788211926.930814:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1788211926.930852:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:3.0:1788211926.930864:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8710d9ba-217c-48be-aa23-80b8773d543b+9:2359:x1875075637835264:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:3.0:1788211926.930897:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a6bea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.930908:0:15127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211926.930914:0:15127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211926.930920:0:15127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a6bea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.930932:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a6bea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788211926.983161:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:3.0:1788211926.989689:0:16671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:3.0:1788211926.989704:0:16671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1788211926.989724:0:16671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6be3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.989741:0:16671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6be3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.989751:0:16671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6be3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.989788:0:16671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211926.989794:0:16671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6be3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.989804:0:16671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6be3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.989825:0:16671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6be3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.989835:0:16671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cb5a5f7/0x2afbce82f55a6be3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211926.989957:0:16671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8710d9ba-217c-48be-aa23-80b8773d543b+11:2359:x1875075637835136:12345-192.168.204.29@tcp:4:dd.0 Request processed in 66455us (266348us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788211926.989968:0:16671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:3.0:1788211926.990005:0:16671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:3.0:1788211926.990017:0:16671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8710d9ba-217c-48be-aa23-80b8773d543b+10:2358:x1875075637835520:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:3.0:1788211926.990049:0:16671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bf1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.990061:0:16671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211926.990066:0:16671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211926.990073:0:16671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211926.990098:0:16671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788211927.058351:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1788211927.058814:0:15127:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00010000:00010000:3.0:1788211927.058832:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a6bea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211927.058844:0:15127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a6bea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211927.058853:0:15127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a6bea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211927.058860:0:15127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788211927.058865:0:15127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a6bea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211927.058873:0:15127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a6bea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211927.058894:0:15127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a6bea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211927.058902:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e040d25/0x2afbce82f55a6bea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211927.059042:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8710d9ba-217c-48be-aa23-80b8773d543b+10:2359:x1875075637835264:12345-192.168.204.29@tcp:4:dd.0 Request processed in 128177us (335419us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788211927.059054:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:3.0:1788211927.059086:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:3.0:1788211927.059099:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8710d9ba-217c-48be-aa23-80b8773d543b+9:2358:x1875075637835392:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:3.0:1788211927.059130:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a6bf8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211927.059789:0:15127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211927.059888:0:15127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788211927.059897:0:15127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a6bf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211927.059913:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a6bf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788211927.114940:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1788211927.116673:0:16671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:1.0:1788211927.116698:0:16671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211927.116713:0:16671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211927.116723:0:16671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211927.116731:0:16671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788211927.116736:0:16671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211927.116745:0:16671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211927.116767:0:16671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bf1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211927.116775:0:16671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004babf9fe/0x2afbce82f55a6bf1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211927.116877:0:16671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8710d9ba-217c-48be-aa23-80b8773d543b+9:2358:x1875075637835520:12345-192.168.204.29@tcp:4:dd.0 Request processed in 126858us (393239us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788211927.116899:0:16671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00010000:00010000:0.0:1788211927.158239:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a6bf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211927.158260:0:15127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a6bf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211927.158269:0:15127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a6bf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211927.158276:0:15127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788211927.158281:0:15127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a6bf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211927.158290:0:15127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a6bf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211927.158311:0:15127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a6bf8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211927.158319:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa21dff9/0x2afbce82f55a6bf8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211927.158455:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8710d9ba-217c-48be-aa23-80b8773d543b+7:2358:x1875075637835392:12345-192.168.204.29@tcp:4:dd.0 Request processed in 99355us (434774us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788211927.158469:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000001:00080000:3.0:1788211927.159055:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:2.0:1788211927.589846:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211928.615094:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788211929.051387:0:16710:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788211929.641736:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211929.823551:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211929.823602:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211929.823635:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211929.823667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211929.823703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211929.823752:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211929.823778:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211929.823806:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637835904 00000100:00100000:2.0:1788211929.823807:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637836416 00000100:00100000:3.0:1788211929.823817:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637835904 00000100:00100000:2.0:1788211929.823817:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637836416 00000100:00100000:0.0:1788211929.823870:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637836160 00000100:00100000:0.0:1788211929.823875:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637836160 00000100:00100000:1.0:1788211929.823888:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637835648 00000100:00100000:1.0:1788211929.823892:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637835648 00000100:00100000:3.0:1788211929.823945:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637836032 00000100:00100000:3.0:1788211929.823949:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637836032 00000100:00100000:1.0:1788211929.823999:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 123 00000100:00100000:1.0:1788211929.824009:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+13:2360:x1875075637835648:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211929.824094:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+13:2360:x1875075637835648:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 76us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211929.824103:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 123 00000100:00100000:1.0:1788211929.824274:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637836288 00000100:00100000:1.0:1788211929.824279:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637836288 00000100:00100000:2.0:1788211929.827664:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:0.0:1788211929.828107:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637835776 00000100:00100000:0.0:1788211929.828116:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637835776 00000100:00100000:0.0:1788211929.828151:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:0.0:1788211929.828160:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2360:x1875075637836160:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211929.828215:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8710d9ba-217c-48be-aa23-80b8773d543b+5:2360:x1875075637835904:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211929.828271:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2360:x1875075637836160:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 112us (4635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211929.828278:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:0.0:1788211929.828296:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:0.0:1788211929.828302:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+20:2360:x1875075637835776:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211929.832850:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8710d9ba-217c-48be-aa23-80b8773d543b+5:2360:x1875075637835904:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 5154us (9229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211929.832871:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:2.0:1788211929.833044:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:2.0:1788211929.833058:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2360:x1875075637836416:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211929.833257:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2360:x1875075637836416:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 203us (9587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211929.833265:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00080000:2.0:1788211929.833575:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788211929.833581:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788211929.833585:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788211929.833625:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8710d9ba-217c-48be-aa23-80b8773d543b+20:2360:x1875075637835776:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 5319us (9918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211929.833638:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:1.0:1788211929.835031:0:15617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1788211929.835044:0:15617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2360:x1875075637836288:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211929.835118:0:15617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2360:x1875075637836288:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 76us (11340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211929.835126:0:15617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:2.0:1788211929.836662:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:2.0:1788211929.836789:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8710d9ba-217c-48be-aa23-80b8773d543b+5:2360:x1875075637836032:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211929.836859:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8710d9ba-217c-48be-aa23-80b8773d543b+5:2360:x1875075637836032:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 185us (13105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211929.836867:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00010000:00010000:3.0:1788211930.664686:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29679 lines, 29679 kept, 0 dropped, 0 bad.